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spectrum  at  zero  frequency. 
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simulation-generated  time  series  for  which  the  extended  Dudewicz -Dalai 
procedure  is  valid. 
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stochastic  behavior  and  thus  provide  an  indication  of  the  robustness 
of  the  multiple  ranking  procedure. 


AFIT  RESEARCH  ASSESSMENT 


AFIT/CI/NR  83-47D 


The  purpose  of  this  questionnaire  Is  to  ascertain  the  value  and/or  contribution  of  research 
accomplished  by  students  or  faculty  of  the  Air  Force  Institute  of  Technology  (ATC).  It  would  be 
greatly  appreciated  if  you  would  complete  the  following  que'tionnaire  and  return  it  to: 

AF IT/NR 

Wright-Patterson  AFB  OH  45433 


RESEARCH  TITLE:  A  Multiple  Ranking  Procedure  Adapted  to  Discrete-Event  Simulation 


RESEARCH  ASSESSMENT  QUESTIONS: 

1.  Did  this  research  contribute  to  a  current  Air  Force  project? 

(  )  a.  YES  (  )  b.  NO 

2.  Do  you  believe  this  research  topic  Is  significant  enough  that  it  would  have  been  researched 
(or  contracted)  by  your  organization  or  another  agency  if  AFIT  had  not? 

(  )  a.  YES  (  )  b.  NO 

3.  The  benefits  of  AFIT  research  can  often  be  expressed  by  the  equivalent  value  that  your 
agency  achieved/received  by  virtue  of  AFIT  performing  the  research.  Can  you  estimate  what  this 
research  would  have  cost  if  it  had  been  accomplished  under  contract  or  if  it  had  been  done  in-house 
in  terms  of  manpower  and/or  dollars? 

(  )  a.  MAN-YEARS  _  (  )  b.  $ _ 

4.  Often  it  is  not  possible  to  attach  equivalent  dollar  values  to  research,  although  the 
results  of  the  research  may,  in  fact,  be  important.  Whether  or  not  you  were  able  to  establish  an 
equivalent  value  for  this  research  (3.  above),  what  is  your  estimate  of  its  significance? 

(  )  a.  HIGHLY  (  )  b.  SIGNIFICANT  (  )  c.  SLIGHTLY  (  )  d.  OF  NO 

SIGNIFICANT  SIGNIFICANT  SIGNIFICANCE 

5.  AFIT  welcomes  any  further  comments  you  may  have  on  the  above  questions,  or  any  additional 
details  concerning  the  current  application,  future  potential,  or  other  value  of  this  research. 

Please  use  the  bottom  part  of  this  questionnaire  for  your  statement(s). 


A  MULTIPLE  RANKING  PROCEDURE 


ADAPTED  TO  DISCRETE-EVENT 
SIMULATION 


APPROVED  BY  SUPERVISORY  COMMITTEE: 


Z2g 


A  MULTIPLE  RANKING  PROCEDURE 


ADAPTED  TO  DISCRETE -EVENT 
SIMULATION 


by 


Robert  Timothy  Dickinson,  B.S.,  M. S. 


DISSERTATION 

Presented  to  the  Faculty  of  the  Graduate  School  of 
The  University  of  Texas  at  Austin 
in  Partial  Fulfillment 
of  the  Requirements 
for  the  Degree  of 

DOCTOR  OF  PHILOSOPHY 


THE  UNIVERSITY  OF  TEXAS  AT  AUSTIN 
December,  1983 


ACKNOWLEDGMENTS 


I  would  like  to  express  my  sincere  appreciation  to  my 
supervising  professor,  Dr.  James  R.  Wilson.  His  guidance, 

understanding,  and  encouragement  were  the  solid  foundation  that 
supported  me  during  my  work.  Anv  contribution  this  paper  makes  to 
simulation  analysis  methodology  reflects  that  support. 

The  lessons  Dr.  Paul  Jensen  taught  me  go  beyond  the  scope  of 
this  effort.  He  is  the  finest  instructor  I  have  ever  had.  It  was  a 
privilege  to  be  in  his  classes. 

I  would  also  like  to  thank  Dr.  Melba  Crawford  and  Dr.  Robert 
Sullivan  for  their  interest  and  help  during  my  months  of  study.  Many 
times  their  encouragement  made  the  long  hours  easier  to  bear. 

Finally  to  my  family,  Joyce,  Brooke,  and  Adrienne,  without 
your  constant  love  and  help  over  the  years,  I  know  1  couldn't  have 
made  it.  The  successful  completion  of  this  goal  is  all  the  sweeter 
because  I  can  share  it  with  you. 


iv 


TABLE  OF  CONTENTS 


i 

L 


Page 


I  INTRODUCTION  . 1 

1.1  Genesis  of  Ranking  and  Selection  Problems  . .  1 

1.2  Complications  Arising  in  Simulation  . . .  3 

1.3  Problem  Statement  . . . . . .  5 

1.4  Objectives  and  Scope  of  the  Research  . . .  5 

1.5  Organization  of  the  Dissertation  . .  7 

II  LITERATURE  REVIEW  .  8 

2. 1  Multiple  Ranking  Procedures  . . .  8 

2.1.1  Indifference  Zone  Approach  .  9 

2.1.2  Subset  Selection  Approach  .  23 

2.1.3  Sequential  Approach  .  24 

2.2  Initialization  Bias  . . . . . .  27 

2.3  Normality  . 34 

2.4  Spectral  Analysis  of  Simulation  Data  .  38 

III  DEVELOPMENT  OF  THE  MULTIPLE  RANKING  PROCEDURE  .  43 

3.1  Introduction  . 43 

3.2  Normality  Test  Procedure  . .  44 

3.2.1  Development  .  44 

3.2.2  Verification  and  Validation  . .  45 

3.3  Initialization  Bias  Test  Procedure  .  45 

3.3.1  Development  . 45 

3.3.2  Verification  and  Validation  .  56 

v 


% 


3.4  Multiple  Ranking  Procedure  for  Correlated  Processes  ..  66 


3.4.1  Extension  of  Dudewicz -Dalai  Procedure  .  66 

3.4.2  Calculation  of  Dudewicz -Dalai  Critical  Values  .  71 

3.4.3  Spectral  Analysis  Procedure  . . 75 

3.4.4  Integrated  Testing  of  Multiple  Ranking  Procedure  85 

IV  EXPERIMENTAL  RESULTS  .  93 

4.1  Comparison  of  Tandem  Queueing  Systems  . .  93 

4.2  Comparison  of  (s,S)  Inventory  Systems  . 102 

V  SUMMARY  AND  RECOMMENDATONS  .  109 

5. 1  Main  Findings  of  the  Research  .  109 

5.2  Recommendations  for  Future  Research  .  110 

APPENDIX  A  .  113 

APPENDIX  B  .  123 

APPENDIX  C  .  134 

APPENDIX  D  .  141 

APPENDIX  E  .  146 

APPENDIX  F  .  169 

REFERENCES  .  175 

VITA  . 181 


LIST  OF  TABLES 


Table  3. 

Table  3. 

Table  3. 

Table  3. 

Table  3. 

Table  3. 

Table  3. 

Table  3. 

Table  4. 

Table  4. 
Table  4. 

Table  4. 


Page 


1  Results  of  testing  subprogram  WLLK  with 

ARMA(p,q)  processes  ... . . .  47 

2  Performance  comparison  for  the  data-truncation 

procedures  IBTEST  and  IBZERO  . .  60 

3  Performance  of  exact  Dudewicz-Dalal  procedure 

DND  for  independent  normal  samples  . . .  74 

4  Performance  of  spectral-estimation  routine 

WELCH  for  Independent  normal  samples  .  84 

5  Performance  of  spectral-estimation  routine 

WELCH  for  ARMA  series  . .  86 

6  Configuration  of  independent  normal  samples 

for  testing  the  integrated  package  NOWAIT  .  87 

7  Performance  of  the  integrated  package 

NOWAIT  for  ARMA  series  . .  91 

8  Configuration  of  ARMA  processes  for  testing 

the  integrated  package  NOWAIT  . .  92 

1  Mean  sojourn  times  W^  for  tandem 

queueing  systems  .  96 

2  Final  results  of  the  first  meta-experiment  .  101 

3  Alternative  (s,S)  inventory  systems  compared 

in  the  second  meta-experiment  .  103 

4  Expected  yearlv  operating  costs  for  (s,S) 

vii 


inventory  systems 


Table  4.5  Final  results  of  the  second  meta-experiment 


viii 


LIST  OF  FIGURES 


Page 


3.1  Flowchart  of  normality  test  Procedure  WILK  .  46 

3.2  Data  sets  used  to  validate  the  initialization  bias  test  49 

3.3  Truncation  point  determined  by  one-sided  cusum  test  ....  52 

3.4  Flowchart  of  initialization  bias  test  procedure  IBZERO  .  57-59 

3.5  Interactive  session  for  testing  transient  AR(1)  series 

by  procedure  I BZERO  . .  62 

3.6  Transient  AR(1)  series  tested  by  IBZERO  .  63 

3.7  Cusum  for  transient  AR(1)  series  tested  by  IBZERO  .  64 

3.8  Cusum  for  AR(1)  series  truncated  by  IBZERO  .  65 

3.9  Detailed  output  of  program  AUTOH  for  one  experiment  ....  76 

3. 10  Flowchart  of  program  AUTOH  for  calculation  of 

Dudewicz-Dalal  critical  values  . . .  77-79 

3.11  Flowchart  of  program  WELCH  for  estimation  of  the 

spectrum  at  zero  frequency  . "2-83 

3. 12  Output  for  independent  normal  test  of  the  integrated 

package  N0WA1T  . .  88 

3. 13  Output  for  independent  normal  test  of  NOWAIT  with  one 

mean  in  the  indifference  zone  . . .  90 

4.1  Layout  of  tandem  queueing  systems  compared  in  the 

first  meta-experiment  . 94 

4.2  Flowchart  of  protocol  for  the  first  meta-experiment  ....  97-99 

4.3  Correlation  function  of  the  sojourn  time  process  for 

ix 


...  nA- 


an  M/M/1  queue  . . . .  108 

•4  Correlation  function  of  the  weekly  cost  process  for 

an  (s,S)  Inventory  system  . . . .  108 


X 


A  MULTIPLE  RANKING  PROCEDURE  ADAPTED 

TO  DISCRETE-EVENT  SIMULATION 
P 

'  Publication  No.  _ 

;  Robert  Timothy  Dickinson,  Ph.D. 

The  University  of  Texas  at  Austin,  1983 
Supervising  Professor:  Dr.  James  R.  Wilson 

A&JTMUT 

The  main  objective  of  this  research  is  to  extend  the  multiple 
ranking  procedure  of  Dudewicz  and  Dalai  to  the  case  of  K  normal 
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discrete-event  simulation  in  order  to  select  the  best  steady-state 
performance  among  K  alternative  policies.  For  each  alternative 
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independently  and  does  not  require  any  information  from  the  runs  for 


77 


other  policies. 

The  analysis  procedure  developed  in  this  research  includes 
subprograms  to  perform  the  following  operations: 

1.  The  application  of  a  cusum  test  to  detect  initialization  bias 
and  to  truncate  the  transient  portion  of  the  output  series. 

2.  The  application  of  a  normality  test  to  ensure  that  the 
original  data  is  organized  into  sufficiently  large  batches  so 
that  the  resulting  hatch  means  are  approximately  normal. 

3.  The  application  of  a  spectral  method  to  account  for  the 
covariance  structure  of  the  batched  series  by  estimating  the 
spectrum  at  zero  frequency. 

The  ultimate  purpose  of  these  subprograms  is  to  yield  a 
simulation-generated  time  series  for  which  the  extended  Dudewicz-Dalal 
procedure  is  valid. 

The  final  objective  of  this  research  is  to  carry  out  an 
extensive  experimental  validation  of  the  analysis  procedure.  The 
systems  used  for  this  validation  exhibit  ouch  diversity  in  their 
stochastic  behavior  and  thus  provide  an  indication  of  the  robustness 
of  the  multiple  ranking  procedure. 


identical,  he  formulated  the  alternative  hypothesis  that  one  of  the 
populations  has  "slipped"  to  the  right  (resulting  in  a  larger  mean  for 
that  population)  relative  to  the  remaining  populations.  Hosteller's 
test  consists  of  (a)  sorting  the  overall  set  of  K*n  sample 
observations  in  ascending  order;  (b)  determining  the  population  with 
the  largest  sample  value;  and  (c)  counting  the  number  m  of 
observations  from  that  population  exceeding  all  values  sampled  from 
the  other  K-l  populations.  If  b  )/  mQ,  the  experimenter  rejects  the 
null  hypothesis  and  accepts  the  hypothesis  that  the  population  with 
the  largest  sample  value  has  slipped  to  the  right.  If  m  <  mQ,  the 
null  hypothesis  is  accepted.  Mosteller  tabulated  the  size  of  this 
test  (that  is,  the  probability  of  Type  I  error)  for  different  values 
of  K,  n,  and  mQ. 

While  Mosteller' s  test  has  the  advantage  of  being  quick  and 
easy  to  apply,  it  is  not  very  powerful.  Moreover,  it  requires  the 
same  sample  size  n  for  every  population.  The  most  important  aspect  of 
this  test,  however,  is  that  it  is  subject  to  a  new  type  of  error. 
Besides  the  classical  Type  I  and  II  errors,  there  exists  the 
possibility  that  the  null  hypothesis  is  correctly  rejected  for  the 
wrong  reason:  the  selected  population  does  not  have  the  largest  mean. 
These  pitfalls  were  clearly  brought  out  in  Mosteller 's  original  paper. 
The  main  contribution  of  this  paper  is  that  it  focused  attention  on  a 
neglected  statistical  problem  of  great  practical  importance.  This 
paper  has  stimulated  extensive  research  efforts  to  develop  effective 
testing  procedures  adapted  to  a  variety  of  experimental  situations. 


CHAPTER  I 


INTRODUCTION 


1.1  Genesis  of  Ranking  and  Selection  Problems 

In  1948  Frederick  Mosteller  published  his  pioneering  work  on  a 
statistical  question  that  he  called  "the  problem  of  the  greatest  one." 
Given  K  populations,  Mosteller  wanted  to  select  the  population  with 
the  largest  location  parameter  (for  example,  the  mean  or  median)  by 
analyzing  random  samples  drawn  from  each  population.  The  word 

population  was  used  by  Mosteller  for  a  process,  tt(6),  which  generates 
independent  random  variables  Xj,  Xj,  ...»  Xn,  each  X^  having  the  same 
density  function  f(x,0).  A  set  of  X^s  that  have  been  generated  by 
tt(0)  is  called  a  random  sample  from  the  corresponding  population. 

The  practical  importance  of  such  a  test  is  obvious.  If 
several  varieties  of  grain  are  being  tested  to  determine  which  variety 
has  the  greatest  mean  yield  per  acre,  the  classical  approach  of  the 
analysis  of  variance  (ANOVA)  is  not  adequate.  As  a  result  of  applying 
the  F-test  of  ANOVA,  the  only  possible  significant  conclusion  is  that 
the  treatment  means  are  unequal  —  and  this  is  frequently  known  at  the 
outset.  The  experimenter's  real  question  —  "Which  is  the  best 
variety  of  grain?”  —  remains  unanswered. 

Mosteller 's  approach  (1948)  was  to  analyze  random  samples  of 
fixed  size  n  taken  from  the  K  populations  using  a  parameter-free 
significance  test  that  differs  fundamentally  from  the  classical  ANOVA 
approach.  Against  the  null  hypothesis  that  all  populations  are 
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1.2  Complications  Arising  in  Simulation 

Although  Mosteller's  procedure  was  discussed  above  in  the 
context  of  an  agricultural  experiment,  it  is  clear  that  the  procedure 
can  be  applied  in  all  branches  of  experimental  science.  For  many 
problems  which  are  either  too  complex  to  solve  analytically  or 
impractical  (structurally  or  economically)  to  test  physically, 
computer  simulation  may  be  the  only  feasible  mode  of  experimentation. 
This  consideration  naturally  leads  to  the  use  of  large-scale  system 
simulations  to  evaluate  and  compare  alternative  policies  for  system 
operation.  By  appropriate  analysis  of  the  simulation-generated  data 
sets,  the  "best"  operating  policy  can  be  identified.  Unfortunately, 
the  following  characteristics  usually  occur  in  the  output  series  for 
each  alternative: 

1.  Initialization  bias 

2.  Unknown  process  variance 

3.  Unknown  autocorrelation  structure 

4.  Marked  nonnormality. 

These  characteristics  pose  major  tactical  problems  in  the  execution  of 
a  simulation  experiment,  and  they  severely  complicate  any  attempt  at  a 
follow-up  ranking-and-selection  analysis. 

Initialization  bias  (Problem  I)  occurs  when  steady-state 
performance  measures  are  required  for  a  real-world  system.  Unlike  the 
real-world  system,  the  corresponding  simulation  model  receives 
Intermittent  uses  over  finite  periods  of  simulated  time.  The 
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experimenter  runs  the  simulation  as  needed,  records  appropriate  data, 
and  then  shuts  the  model  down.  Among  the  most  difficult  questions  in 
discrete  event  simulation  are  the  problems  of  determining  how  to  start 
the  model  and  how  to  obtain  measurements  that  are  not  biased  by  the 
method  of  starting  (Conway,  1963). 

Classical  methods  of  statistical  analysis  are  based  on 
independent  observations  from  a  single  normal  population  with  a  known 
variance.  Unfortunately,  it  has  been  well  documented  (Fishman,  1973, 
1978;  Kleijnen,  1975;  Law  and  Kelton,  1982)  that  the  output  responses 
generated  by  computer  simulations  of  realistic  systems  are  neither 
independent  (Problem  3)  nor  normal  (Problem  4).  Moreover,  the 
variance  of  the  response  is  usually  unknown  and  unequal  across 
alternative  system  configurations  (Problem  2).  While  these  four 
problems  are  not  limited  to  simulated  experimentation,  they 
substantially  detract  from  the  attractiveness  of  discrete-event 
simulation  as  a  method  for  comparing  alternative  policies. 

Two  unique  advantages  of  computer  simulation  have  motivated 
efforts  to  overcome  these  four  tactical  problems.  The  first  advantage 
is  one  that  experimentalists  always  seek  to  achieve  —  perfect 
homogeneity  of  the  experimental  medium.  In  a  simulation  experiment, 
the  experimental  medium  is  a  sequence  of  events  which  describe  the 
activities  of  the  outside  world.  Since  this  sequence  is  a  function  of 
the  pseudo-random  numbers  that  are  sampled  to  drive  the  model's 
exogenous  stochastic  input  processes,  the  experimenter  can  reproduce 
an  Identical  sequence  of  discrete  events  whenever  such  duplication  is 


A 


5 


desired.  The  second  advantage  of  simulated  experimentation  is  the 
ability  to  perform  statistical  analysis  and  control  of  the  simulation 
as  it  is  being  run.  After  the  operation  of  a  discrete-event 
simulation  has  been  temporarily  suspended  to  perform  some  type  of 
calculation  on  the  results  already  obtained,  it  can  be  resumed  with  no 
loss  of  information  by  returning  control  to  the  executive  time-advance 
procedu re. 

1.3  Problem  Statement 

Given  a  discrete-event  simulation  model  of  a  real-world 
system,  the  problem  is  to  select  the  best  operating  policy  from  K 
given  alternatives.  This  requires  the  development  of  a  multiple 
ranking  procedure  that  will  monitor  the  relevant  output  processes 
generated  by  each  alternative  and  that  will  finally  yield  a  correct 
selection  from  the  set  of  alternatives  with  a  user-specified  level  of 
reliability.  The  ranking  procedure  oust  include  effective  techniques 
for  handling  initialization  bias,  nonnormality,  autocorrelation,  and 
variance  estimation  in  the  processes  to  be  analyzed. 

1.4  Objectives  and  Scope  of  the  Research 

The  main  objective  of  this  research  is  to  extend  the  multiple 
ranking  procedure  of  Dudewicz  and  Dalai  (1973)  to  the  case  of  K  normal 
covariance-stationary  processes  with  unknown  and  nonidentical 
covariance  structures.  To  inclement  this  procedure,  we  develop  a 
computer  program  that  can  be  called  "on  the  fly"  by  an  ongoing 


discrete-event  simulation  in  order  to  select  the  best  steady-state 
performance  among  K  alternative  policies.  For  each  alternative 
policy,  this  support  package  analyzes  the  simulation-generated  output 
series  to  determine  if  the  accumulated  sample  size  is  sufficient  to 
meet  the  predetermined  probability  requirement  (that  is,  the 
probability  of  yielding  the  correct  selection).  If  the  run  length  is 
not  sufficient,  the  program  determines  the  number  of  additional 
observations  to  be  taken.  Upon  reaching  an  acceptable  run  length,  the 
program  reports  the  estimated  mean  response  of  the  policy  currently 
under  consideration.  The  run  for  each  alternative  policy  is  executed 
independently  and  does  not  require  any  information  from  the  runs  for 
other  policies. 

The  analysis  procedure  developed  in  this  research  includes 
subprograms  to  perform  the  following  operations: 

1.  The  application  of  the  cusum  test  of  Schruben  (1982)  to  detect 
initialization  bias  and  to  truncate  the  transient  portion  of 
the  output  series 

2.  The  application  of  the  normality  test  of  Shapiro  and  Wilk 
(1965)  to  ensure  that  the  original  data  is  organized  into 
sufficiently  large  batches  so  that  the  resulting  batch  means 
are  approximately  normal 

3.  The  application  of  the  spectral  method  of  Heidelberger  and 
Welch  (1981a)  to  account  for  the  covariance  structure  of  the 
batched  series  by  estimating  the  spectrum  at  zero  frequency 


for  that  series 
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The  ultimate  purpose  of  these  subprograms  is  to  yield  a 
simulation-generated  time  series  for  which  the  extended  Dudewicz -Dalai 
procedure  is  valid. 

The  final  objective  of  this  research  is  to  carry  out  an 
extensive  experimental  validation  of  the  analysis  procedure.  The 
following  systems  are  used  in  the  validation  study: 

1.  Several  sets  of  autoregressive-moving  average  processes 

2.  A  set  of  open,  feed-forward  queueing  networks 

3.  A  set  of  (s,S)  inventory  systems. 

These  experimental  vehicles  exhibit  much  diversity  in  their  stochastic 
behavior  and  thus  provide  an  indication  of  the  robustness  of  the 
multiple  ranking  procedure. 

1.5  Organization  of  the  Dissertation 

Chapter  II  provides  a  survey  of  the  literature  on  the 
following  topics:  (a)  ranking-and-selection  procedures,  (b)  tests  for 
initialization  bias,  (c)  tests  for  normality,  and  (d)  spectral 
analysis  of  simulation  output.  Chapter  III  presents  the  development 
of  the  extended  Dudewicz-Dalal  procedure  together  with  all  of  its 
required  support  routines.  Chapter  IV  contains  a  tabulation  and 
analysis  of  the  results  of  the  experimental  validation  study.  A 

t 

precis  of  the  main  findings  of  this  research  is  given  in  Chapter  V 
along  with  recommendations  for  future  work. 


CHAPTER  II 


LITERATURE  REVIEW 

2.1  Multiple  Ranking  Procedures 

After  Mosteller's  work,  the  next  significant  step  in 
attempting  to  solve  "the  problem  of  the  greatest  one"  was  completed  by 
Bahadur  (1950).  In  his  work  Bahadur  reiterated  the  fact  that  the 
usual  statistical  theory  for  testing  hypotheses  of  the  form 

Ho:  U1  “  U2  *  *•*  “  UK 

is  inadequate  where  a  definite  course  of  action  is  required  to  select 
the  best  population.  He  proceeded  to  consider  explicitly  the  purpose 
of  selection  and  the  loss  involved  in  making  any  particular  erroneous 
selection.  Using  the  same  definition  of  population  and  the  same  goal 
as  Hosteller,  Bahadur  proved  that  selecting  the  population  with  the 
largest  sample  mean  is  the  optimal  procedure  under  the  following 
conditions: 

1.  Impartial  selection  is  required. 

2.  The  experimenter  seeks  to  maximize  the  probability  of 
correctly  selecting  the  population  with  the  optimal  expected 
value. 

3.  The  basic  observations  are  independent  normal  random 
variables. 

4.  The  sample  sizes  are  equal. 

For  other  unknown  parameters  which  are  to  be  compared,  Bahadur  cites 
necessary  and  sufficient  conditions  that  must  be  met  to  ensure  the 
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following  property:  If  and  X2  are  independent  estimates  of  the 
corresponding  unknown  parameters  and  C2,  and  in  a  given  instance  Xj 
>  X2,  then  it  is  more  reasonable  to  suppose  that  >  C2  than  to 
suppose  that  Cj  <  C2«  It  was  this  basic  work  in  the  ranking  of 
unknown  parameters  based  on  random  samples  that  lead  J.P.C.  Kleijnen 
(1975)  to  state,  "Historically,  multiple  ranking  procedures  can  be 
traced  back  to  the  work  of  Bahadur  in  1950." 

After  the  pioneering  work  of  Mosteller  and  Bahadur,  procedures 
to  solve  "the  problem  of  the  greatest  one"  branched  into  three 
separate  approaches.  These  three  methods  of  ranking  alternatives  are 
classified  as  follows: 

1.  Indifference  Zone  Approach 

2.  Subset-selection  Approach 

3.  Sequential  techniques. 

All  three  methods  come  under  the  general  heading  of  ranking  -  and  - 
selection  procedures  or  multiple  ranking  procedures  (MRP).  It  is  this 
latter  nomenclature  that  will  be  used  throughout  this  dissertation. 

2.1.1  Indifference  Zone  Approach 

Although  the  groundwork  was  laid  by  Mosteller  and  Bahadur,  it 
was  R.  E.  Bechhofer’s  effort  in  the  MRP  area  which  represented  a  major 
event  in  statistical  thought  (Dudewicz,  1976).  Bechhofer  (1954) 
developed  a  procedure  for  determining  the  number  of  observations 
required  for  selecting  the  single  "best"  population  (that  is,  the 
population  with  the  largest  mean  value)  from  K  competing  populations 
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based  on  a  predetermined  probability  of  correct  selection.  While 
Bahadur  justified  using  the  sample  means  to  compare  the  true  means  of 
normal  populations,  Bechhofer  specified  how  large  a  sample  size  would 
be  required  to  ensure  a  desired  probability,  P*,  that  the  correct 
population  is  chosen  by  the  test  procedure.  Bechhofer 's  procedure 
also  allowed  the  experimenter  to  select  an  "indifference  zone"  which 
effectively  prevented  the  experimenter  from  taking  large  samples  to 
detect  only  small  differences  in  sample  means.  Bechhofer's  problem 
statement  can  be  summarized  as  follows: 

There  exist  K  populations  ir,(i*l,  2 . .  where 

u[l]  <  u  [2]  <  •**  <W  [K-l]  <  ^  [K] 

represent  the  ranked  means.  The  objective  is  to  select  the  population 
with  the  largest  mean  u [k]* 

Bechhofer's  procedure  specifies  the  size  n  of  the  random 
sample  to  be  taken  from  each  population  so  that  by  choosing  the 
population  with  the  largest  sample  mean,  the  probability  of  a  correct 
selection  (CS)  is  greater  than  or  equal  to  a  predetermined  constant 
P*.  Since  large  samples  are  required  to  select  the  best  population  if 
the  population  means  differ  only  slightly  (and  the  loss  involved  in  a 
wrong  selection  is  then  small),  the  requirement  for  a  floor  on  Pr(CS) 
is  necessary  only  if  the  best  population  mean  is  at  least  a  specified 
number  of  units.  A*  (A*  >  0),  better  than  the  next  best  mean. 

Symbolically,  this  requirement  has  the  form 

Pr(CS)  >  P*  if  u[K]  -  }i  [K-l  J  >  (2.1.1) 

where  A*  indicates  the  size  of  the  "indifference  zone”. 


In  his 
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original  work,  Bechhofer  concentrated  on  a  single-sample  method  for 
selecting  the  best  population;  and  he  assumed  that  all  observations 
are  independent  and  are  taken  from  normally  distributed  populations 
with  a  known  common  variance.  Bechhofer  also  extended  his  procedure 
to  the  selection  of  the  population  with  the  smallest  mean  and  to  the 
selection  of  the  populations  with  the  m  "best”  (largest  or  smallest) 
means  (m  <  K). 

In  determining  the  proper  sample  size,  Bechhofer  introduced 
the  concept  of  the  "least  favorable  configuration"  (LFC).  Bechhofer 
stated  that  the  probability  requirement  (2.1.1)  must  be  valid  when  the 
K  unknown  population  means  are  arranged  in  a  configuration  that  makes 
it  the  most  difficult  to  distinguish  the  best  of  the  population  means. 
He  showed  that  this  LFC  occurs  when: 

Ui  -  ...  "  U[K-1]  *  U  [K]  "  A* 

If  the  means  do  not  fall  in  this  configuration,  then  the  actual 
probability  of  correct  selection  exceeds  the  floor  P*. 

In  a  simplified  derivation  of  the  formula  for  the  common 

It  A 

sample  size  n  given  P  and  A  ,  Barr  and  Rizvi  (1966)  show  that 
solving  equation  (2.1.2)  for  h  and  then  substituting  the  result  into 
equation  (2.1.3)  determines  the  required  sample  size: 


where 


P*  *  m J  (x  +  h)  d  $(x) 

1/K  <  P*  <  1,  $  is  the  standard  normal 

distribution  function,  and 


(2.1.2) 


n  • 


(a  h/A*)2 


(2.1.3) 
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and  where  0  -  known  common  standard  deviation  of  all  K  populations. 
Bechhofer  (1954)  tabulated  values  of  h  in  his  original  paper. 
Obviously  h  and  n  increase  as  K  and  P*  increase.  In  a  paper  published 
15  years  later,  Dudewicz  (1969)  relieved  the  experimenter  of  having  to 
solve  (2.1.2)  or  having  to  use  tables  to  find  the  appropriate  h  value. 
An  accurate  computing  formula  for  h  was  shown  to  be 

h(P*,K)  -  2  [-  n(l-P*)]1/2  (2.1.4) 

While  this  breakthrough  by  Bechhofer  allowed  the  experimenter 
to  predetermine  P  and  A  ,  it  had  a  major  drawback  in  requiring  a 
known  common  variance  for  all  populations.  Bechhofer,  Dunnett  and 
Sobel  (1954)  subsequently  developed  a  two-sample  procedure  for  ranking 
K  normal  populations  with  unknown  variances 

°i2  “  ai  0  2  °i  *  2,  ...»  K, 

y 

where  0  is  unknown  but  the  a^s  are  known.  This  procedure  also 
requires  calculation  of  a  critical  value  h  in  a  manner  similar  to 
Bechhofer's  first  paper.  The  two-sample  procedure  is: 

1.  Take  an  initial  sample  of  ajN0  observations  from  the  ith 
population  tt^  (i  ■  1,  2,  ...,  K). 

2.  Calculate  the  mean  square  error, 

So  ”  V"1  1  E°  <xii  "  x>2 

i-1  j-1  J 

2 

This  is  an  unbiased  estimate  of  0  with 
k 

V  -  N  Z  a,  -  K 
o.  ,  i 


degrees  of  freedom. 
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3.  Take  a  second  sample  of  (N  -  NQ)a.  observations  from  each  of 

the  (i  «  1,  2,  X)  populations,  where 

N  -  max  {N0,  [2  S*  (hn/  A*)2]  }  (2.1.5) 

In  equation  (2.1.5),  [*]  denotes  the  greatest  integer 
function,  and  h  -  h(NQ,  X,  P*)  is  obtained  from  Table  3  of 
Dunnett  and  Sobel  (1954).  If  N  equals  Nq,  a  second  sample  is 
unnecessary. 

4.  Calculate  for  each  ^  the  overall  sample  Kan 

a.N 

Xj  -  (ajN)-1  i  Xjj  (i  -  1,  2,  ...,  K) 


Denote  the  ranked  values  of  by 


<  <  •••  <  Vr 

5.  Rank  the  U  ^  according  to  the  ranking  of  the  observed  X^  — 
that  is,  select  the  population  which  gave  rise  to  Xjkj  as  the 
"best"  population. 

C.  W.  Dunnett  (1960)  considered  the  situation  of  ranking  K 
normal  populations  with  unknown  means,  equal  variances  and 
covariances,  and  some  a  priori  information  about  the  distribution  of 
the  unknown  population  means.  Specifically,  the  unknown  population 
means  are  themselves  normally  distributed.  A  typical  problem  to  which 
this  model  could  apply  is  the  selection  of  the  best  of  K  varieties  of 
grain  which  have  been  chosen  at  random  from  the  same  parent  population 
of  grain  varieties.  Another  extension  developed  by  Dunnett  applies  to 
the  case  where  there  is  prior  knowledge  about  the  values  of  the 
population  means.  This  a  priori  information  is  used  to  justify  a 


smaller  sample  size  Chan  Is  dictated  by  Bechhofer's  procedure  because 
It  Is  known  that  the  LFC  does  not  occur.  Here  again  Dunnett 
recognized  the  possibility  of  various  definitions  of  "best,"  depending 
upon  the  requirements  of  the  particular  application.  He  assumed,  as 
did  his  predecessors,  that  there  is  a  single  characteristic  by  which 
the  various  experimental  populations  are  to  be  judged,  and  that  the 
best  population  is  the  one  which  possesses  on  the  average  the  highest 
value  of  this  characteristic.  Dunnett 's  procedure  has  not  been  widely 
used  because  certain  multivariate  normal  integrals  required  by  the 
procedure  have  not  been  tabulated.  This  procedure  is  also  encumbered 
by  the  questionable  accuracy  of  the  a  priori  information  on  which  it 
is  based. 

Somerville  (1970)  also  approached  the  idea  of  ranking 

alternatives  through  the  use  of  a  probability  requirement  and  an 
indifference  zone,  but  he  tied  both  P*  and  A*  to  economic  costs.  His 
procedure  determined  the  "optimum"  sample  size  for  choosing  the 

population  having  the  best  (largest  or  smallest)  mean  when  a  specified 
economic  loss  is  suffered  if  an  incorrect  decision  is  made.  In  this 
situation,  the  expected  loss  due  to  an  incorrect  decision  must  be 
balanced  against  the  expected  cost  of  experimentation.  Somerville 
arrived  at  the  same  LFC  as  Bechhofer;  but  he  used  the  minimax 

principle,  with  A*  and  P*  being  determined  by  economic  costs  instead 
of  being  specified  by  the  experimenter.  His  basic  assumptions 

(normality,  known  variances,  Independent  observations)  coincided  with 


those  of  Bechhofer 


15 


Chambers  and  Jarrett  (1964)  also  followed  the  path  of 
Bechhofer  In  deciding  how  large  a  sample  should  be  taken  from  each  of 
K  populations  in  order  to  give  at  least  a  specified  probability  of 
selecting  the  best  population  when  the  indifference  zone  has  width  A*. 

However,  their  double  sampling  procedure  is  designed  to  select  the 

o 

best  of  K  nonnormal  populations  when  the  population  variances  { J 
depend  on  the  corresponding  unknown  means  {  }  ;  and  the  form  of  this 

relationship 

at  *  a  (u  i) 

is  known  and  common  to  each  population.  Binomial  and  Poisson 
populations  provide  examples  of  this  situation.  The  Chambers  and 
Jarrett  procedure  is  shown  to  be  valid  only  for  large  samples.  For 
example,  they  used  an  initial  sample  size  of  750  for  selecting  the 
best  of  3  binomial  populations  with  P*  »  0.95  and  A*  *  0.02. 

Chambers  and  Jarrett 's  derivation  of  the  proper  sample  size 
closely  follows  the  analvsis  given  by  Barr  and  Rizvi  (1966)  for  the 
Bechhofer  procedure.  (See  equation  (2.1.2).)  The  recommended 
procedure  is:  (assuming  "best”  as  smallest  mean) 

1.  An  initial  sample  of  size  NQ  is  taken  from  each  population, 

^  (i  “  1,  2,  ...,  K). 

2.  The  smallest  sample  mean  is  used  to  estimate  the  smallest 
population  mean 

3.  The  total  sample  size  N  needed  from  each  population  is 
estimated  by  inserting  the  estimated  y^j  into  equation 
(2.1.6): 


’  /*  '  mfit '  fit  11"  i  ”  » 
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r 00  u  -  6 

P*  -  J  4>(u)  11  -  4>( - -~)]K_1  du,  (2.1.6) 

where  $  and  $  respectively  denote  the  standard  normal 
density  and  distribution  functions,  and  where 

*  °<um  +  A*>  *  A* 

o(U[i]>  ’  °C'J[i]) 

4.  An  extra  sample  of  size  N  -  NQ  should  be  taken  from  each 
population  (none  if  N  <  NQ). 

5.  The  population  yielding  the  smallest  final  sample  mean  is  then 
selected  as  the  "best"  population. 

One  advantage  of  this  two-stage  procedure  is  that  it  allows  A* 
to  be  specified  as  a  percentage  of  the  smallest  population  mean  rather 
than  as  an  absolute  quantity.  Again  following  the  form  of  Bechhofer’s 
original  work,  Chambers  and  Jarrett  discussed  the  idea  of  a  LFC  and 
they  produced  tables  that  specify  values  of  <5  *. 

Up  to  this  point,  all  MRPs  required  some  prior  knowledge  of 
the  value  of  the  population  variance.  Either  the  actual  value  of  the 
variance,  known  variance  ratios,  or  a  known  functional  relationship 
with  the  unknown  mean  had  to  be  available  to  the  experimenter  before 
any  decisions  could  be  made.  The  next  logical  step  in  the  evolution 
of  MRPs  was  taken  by  Dudewicz  and  Dalai  (1975)  —  namely,  the 
development  of  a  procedure  which  solves  the  general  ranking  problem 
with  <7^(i  ■  1,  2,  ...,  K)  unknown  and  unequal.  They  considered  the 
same  problem  addressed  by  Bechhofer  —  including  the  concepts  of  a 
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probability  requirement  P*,  an  indifference  zone  A*,  and  a  LFC,  but 
without  the  assumption  of  known  and  equal  variances*  For  this 
situation,  Dudewicz  and  Dalai  developed  the  following  two-stage 
procedure,  PE,  to  determine  the  required  sample  size  n^  for  the  1th 
population: 

1.  Take  an  initial  sample  i»  •••»  Xi  n  ^  s*ze  n0(>2) 

from  tt  ^ (i  «  1,  2,  ...,  K)  and  define 


(nc)  - 

o  „  . 

I  xi  4/nQ 

j-l 

(2.1.7) 

n 

0 

-  X 

«i.,  -  -  ‘> 

(2.1.8) 

j-* 

*  max 

t  nc  +  1,  [(S^/A  *)2]  } 

(2.1.9) 

where  [z]  denotes  the  smallest  integer  }  z  and  h  •*  h  (K,  P*) 

o 

is  the  unique  solution  of 

OO 

f  {[Fn  (z+h)]  K~l  }fn  (z)dz  -  P*  (2.1.10) 


where  Fn  (*)  and  fn  (*)  are  respectively  the  distribution  and 
density  function  of  a  Student's  -t  random  variable  with  nQ  -  1 
degrees  of  freedom. 

2.  Take  n^  -  nQ  additional  observations 

X1>n  ...»  Xi>n^  from  fr^(i  “  1,  2,  •».,  K) 
and  define 

n4 


-  j1 


J-l 


aij  Xij 


(2.1.11) 


where  the  (i  ■  1,  2,  ... ,  K;  J  ■  1,  ...»  t^)  are  chosen 


v  -j »i*r  * 
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so  that 


I1  ati  -  1  (2.1.12) 

j-1  J 


il 


in. 


l  *  ?  a, ,2  -  (  A*/h)2 


j-1 


(2.1.13) 

(2. 1.14) 


(Note:  For  K  <  3  this  weighting  scheme  is  not  required.  The 

mean  of  n^  observations  is  used  for  comparison. ) 

3.  Rank  the  populations  based  on  the  values  where 

^[1]  ^  *[2]  ^  ^  "^[K]  anc*  se^ect  the  population 

<v 

which  yields  (largest  sample  mean). 

The  justification  for  this  procedure,  as  presented  in  the 

—  O 

paper,  shows  that  the  method  is  independent  of  the  (i  ■>  1,  2, 

...,  K)  values  and  that  Pr(CS  I  Pg,  LFC)  ■  P*.  Extensive  P*  tables  are 
provided  in  the  paper  for  varying  values  of  K,  nQ,  and  h. 

o 

In  a  previous  paper,  Dudewicz  (1971)  showed  that  if  the 
are  not  known,  no  single-stage  sampling  procedure  can  satisfy  the 
probability  requirement  (2.1.1).  While  Dudewicz  admitted  that  there 
might  be  some  resistance  to  a  nulti-stage  procedure,  he  emphasized  two 
important  points:  (a)  double  sampling  plans  achieve  almost  the  same 
efficiency  Increase  over  a  single  sampling  as  that  achieved  by  a  fully 
sequential  plan;  and  (b)  in  most  cases,  the  first  stage  of  a  double 
sampling  plan  is  actually  equivalent  to  running  a  pilot  study  for 
preliminary  variance  estimation  prior  to  carrying  out  a  fully 
sequential  procedure  (see  also  Dudewicz,  Ramberg,  and  Chen,  1975). 
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Dudewicz,  Ramberg,  and  Chen  (1975)  also  presented  a  Procedure 
IP  that  is  equivalent  to  the  previously  shown  P£  but  is  more  amenable 
to  machine  computation.  Procedure  is: 

1.  Complete  step  1  of  P£ 

2.  Take  n^  -  n  additional  observations  ...»  Xj  n  from 

*  tlo  ’  i 

11  ^  and  calculate  the  new  sample  mean 


—  *  _ini 

X^(nj  ~  n  )  *  (n.  -  n  )  E  Xj., 

j-"o+1 


(2.1.15) 


the  weights 

Wi  "  ^nQ/ ni ) I l+( In1(hS^/  &*)"2  -  l](ni  -  n0)/n0)1/2]  (2.1.16) 


w4  -  1  -  wA  , 

and  the  final  weighted  mean 


(2.1.17) 


Xi  -  W1Xi(nQ)  +W^(ni-no)  for  i-1 . K.  (2.1.18) 

3.  Complete  step  3  of  P£. 

Dudewicz,  Ramberg,  and  Chen  (1975)  presented  the  numerical 
analysis  that  they  used  to  compute  extensive  tables  of  the  critical 
value  h  as  a  function  of  nQ,  K,  and  P*.  The  solution  procedure  for 
equation  (2.1.10)  involves  a  nonsequential  search  over  a  grid  of  h 
values.  For  each  value  of  h,  a  128-point  Gauss-Legendre  quadature 
formula  is  used  to  approximate  the  required  integral  over  9 
laboriously  determined  subintervals.  In  Chapter  III,  we  develop  a 
solution  procedure  which  is  completely  automated  and  is  therefore 
suitable  for  use  in  discrete-event  simulation. 

As  waB  the  case  for  the  original  Bechhofer  paper  in  1954,  both 
procedures  P-  and  7  can  be  generalized  to  select  the  population  with 
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the  m  best  means  (1  ^  m  <  K).  It  is  important  to  note  that  the 
extended  selection  procedure  will  not  indicate  that  the  m  selected 
populations  are  ranked  or  ordered  in  any  way  among  themselves;  the 
probability  requirement  only  refers  to  the  event  in  which  the 
unordered  set  of  m  selected  populations  is  the  same  as  the  unordered 
set  of  the  m  best  populations.  This  particular  selection  goal  might 
be  useful  if  it  is  decided  to  identify  several  good  options,  since  the 
best  population  might  prove  unacceptable  for  other  reasons.  The 
procedure  given  by  Bechhofer  (1954)  could  be  used  to  select  the  m  best 
populations  and  to  specify  the  proper  ordering  of  all  m  populations. 

For  the  simulator,  both  these  procedures,  P£  and  3d  ,  were 
most  welcome.  To  be  able  to  finally  shake  the  bounds  imposed  by 
having  to  assume  some  known  property  of  the  population  variance 
greatly  increased  the  practical  value  of  MRPs.  This  is  borne  out  by 
the  following  statement  in  Law  and  Kelton  (1982):  "Assuming  known  or 
equal  variances  is  very  unrealistic  in  simulation.” 

The  last  major  hurdle  in  using  MRP  to  analyze  discrete-event 
simulation  is  the  presence  of  serial  correlation  in  the  output  series. 
Dudewicz  and  Zaino  (1977)  chose  to  model  the  observations  from  such  a 


°2/(l-  P2) 


(2.1.21) 


RS  -  Cov(Xin,  Xi>n+S)  -  [  a2/(l-  p  2)J  .  p18  »  -  0  2  p'8  1  (2.1.22) 

Using  this  AR(1)  model,  Dudewlcz  and  Zaino  showed  that  the  proper 
sample  size,  N^,  to  use  to  compensate  for  the  known  covariance 
structure  (2.1.22)  Is  found  by  taking  N-j  to  be  the  smallest  Integer 
satisfying 

N-,  _ 

2  p(l  -  p  3)  1  1 

- —  >  <  -  ,  (2.1.23) 

N3(l  -  p)2  J  N 

where  N  is  the  sample  size  required  by  Bechhofer's  (1954)  procedure  in 

the  case  that  p  *  0.  The  onlv  deviation  from  Bechhofer's  basic 

assumptions  are: 

1.  A*  is  specified  as  a  percentage  of  ox»  equation  (2.1.20); 

2.  The  population  sample  observations,  X.^  j(j  «  1,  2,  ...,  n), 
are  not  independent;  and 

3.  All  (i  ■  1,  ...,  K)  are  equal. 

A  good  approximation  to  is  given  by 
1  +  P 

N2  -  N  -  (2.1.24) 

1  -  p 

for  values  of  p  >  -0. 5.  The  authors  also  present  several  graphs  that 
show  how  the  required  sample  size  grows  as  the  value  of  Ip! 
increases.  This  fact  is  intuitively  obvious  since  as  ]  p  j  increases, 
a  fixed  number  of  samples  will  yield  "less"  information  about  the 
population  mean, 

Dudewlcz  and  Zaino  extended  their  procedure  to  the  .  .tuatlon 


i  r  (i  +  p) 
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in  which  the  values  are  unknown  and  unequal.  Finally  they 

considered  the  situation  in  which  both  a2  and  p^  are  unknown  and 
unequal.  For  this  latter  condition,  the  Dudewicz  and  Zaino  heuristic 
procedure  is: 

1.  Take  an  initial  sample  size  of  NQ  »  30  from  each  simulation 
model  (population).  Calculate  the  number  of  observations 
which  would  be  needed  if  p^  -  0: 

-  max(N0,  [(S^/  A*)2])  ,  (2.1.25) 

where  (S^h/A  *)  is  calculated  from  step  1  of  the  Dudewicz  and 
Dalai  (1975)  procedure.  If  Mi  >  NQ  take  Mj  -  NQ  additional 
observations. 

2.  Using  all  Mi  observations,  calculate  the  sample  mean  and 
the  sample  lag-one  correlation  coefficient 


E,  <xi»  -  -  V 

n-2 

_  — 

E,  <xin  -  xi> 
n-1 


(2.1.26) 


Form  the  100(1  -  a  )%  confidence  interval  for  from 


(  pi  “  Pt)2  <: 


M1  -  1 
M1(Mi-3) 


(1 


Pi>  %-3  t1  -  a/2)  , 

1  (2.1.27) 


where  a  ■  .05  and  tr(q)  is  the  lOOq  percent  point  of 
Student's  -  t  distribution  with  r  degrees  of  freedom.  If  the 
interval  (2.1.27)  contains  p  ^  ■  0,  Judge  to  be  an 
adequate  sample  size  for  population  i  and  go  to  step  4. 

3.  If  the  interval  from  step  2  does  not  contain  p  j  ■  0, 
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calculate 

1  +  Pt 

N2i  "  Mi  -  (2.1.28) 

1  -  Pi 

and  take  additional  observations  from  population  i. 

4.  Using  all  the  observations  taken  from  population  i,  compute 
the  overall  sample  mean  X^  and  select  that  population  which 
produces  the  largest  X^l  *  1,  2,  ...,  K). 

Two  points  should  be  emphasized  about  this  scheme.  The  first 

is  that  all  the  Dudewicz  and  Zaino  procedures  are  valid  only  if  an 

AR(1)  process  accurately  models  the  output  data.  Secondly,  only 

lag-one  correlation  is  taken  into  account.  It  is  still  assumed  that 

the  observations  across  alternatives  are  independent,  i.e.  X.  .  is 

1 » J 

independent  of  X^+  £  j  (  &  »  1,  2 . . 

2.1.2  Subset  Selection  Approach 

Another  method  of  comparing  alternatives  was  pioneered  by 
Gupta  (1956).  In  the  subset  selection  approach,  the  goal  Is  to  select 
a  non-empty  subset  of  the  populations  so  as  to  Include  the  best 
population.  In  this  approach,  the  size  of  the  selected  subset  is  not 
fixed  in  advance,  but  is  determined  by  the  observations  themselves. 
For  the  problem  of  K  normal  populations  with  unknown  means  and  a 
common  known  variance,  the  procedure  developed  by  Gupta  (1956)  selects 
the  population  that  yields  X^  if  and  only  if 

>  (max  Xj)  -  d  0/ ni/z  (2.1.29) 

u  ja 
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where  o  *  common  known  population  variance 
n  *  common^sample  size 
d  •  d(K,  P  )  >  0  is  the  solution  to 

P*  - ^y%K-1(t+d)d  •  4>(t)  dt, 


(2.1.30) 


where  $  is  the  cumulative  distribution  function  of  a  standard  normal 
variable.  Work  has  also  been  done  by  Gupta  to  handle  common  unknown 
variances  and  unequal  variances.  The  subset  selection  approach 
differs  from  the  indifference  zone  technique  in  that  the  latter 

£  A 

requires  specification  of  two  constants  P  and  A  to  select  a  fixed 
number,  m,  of  "best"  populations,  while  the  former  only  requires  P  to 
pick  a  random-sized  set  containing  the  best  population. 

Kleijnen,  Naylor  and  Seeks  (1972)  have  suggested  that  the 
subset  selection  procedure  can  be  used  to  reduce  the  number  of 
possible  alternatives  when  K  is  large;  then  the  indifference-zone 
technique  can  be  applied  to  the  remaining  alternatives  to  find  the 
"best"  population.  This  approach  is  onlv  appropriate  if  the 
experimenter  is  seeking  a  single  "best"  population  (m*l).  This 
approach  will  not  work  for  m  ~>/  2  because  there  is  no  way  to  ensure 
that  every  population  whose  mean  falls  within  A*  units  of  the  "best” 
population  mean  will  be  included  in  the  subset  selected  by  Gupta's 
procedure.  Missing  some  nearly  optimal  populations  can  be  quite 
damaging  if  those  populations  possess  a  secondary  attribute  which 
makes  them  more  desirable  than  the  "best”  population. 


2.1.3  Sequential  Approach 

Both  of  the  previously  discussed  MRP  approaches 


subset 
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selection  and  indifference  rone  —  are  either  single-stage  or 
two-stage  procedures.  Starr  (1966)  showed  that  it  is  more  efficient 
for  the  experimenter  to  take  observations  one  at  a  time  and  terminate 
the  experiment  based  on  a  known  stopping  rule  as  soon  as  the  desired 
goal  is  reached.  Sequential  MRPs  have  this  trait. 

Bechhofer  (1958)  developed  the  following  sequential  procedure 
for  finding  the  "best  one  of  several  normal  populations  with  a  common 
known  variance”: 

1.  At  the  m-th  stage  of  experimentation  (m  *  1,  2,  ...),  take  an 
observation  from  each  of  the  K  populations.  Starting  with 

m  ”  2,  compute  the  stopping  statistic  zm(dm).  For  complete 
details  on  the  form  of  the  stopping  statistic,  see  Bechhofer 
(1958). 

2.  If  zm(dm)  <  (1  -  P*)/P*,  stop  experimentation  and  select  the 
population  with  the  largest  sample  mean. 

3.  If  >  (1  -  P*)/P*,  take  another  observation  from  each  of 

the  populations,  replace  m  by  nri-1,  and  go  to  step  2. 

Due  to  the  tedious  computations  required  at  each  stage  to  check  the 

stopping  rule,  Bechhofer  and  Blumenthal  (1962)  devised  a  new  computing 

formula  for  Z  (d_). 

m  m 

Paulson  (1964)  developed  an  alternative  to  Bechhofer's 
sequential  procedure  which  is  substantially  easier  to  use.  Paulson's 
procedure  includes  the  ability  to  eliminate  certain  populations  from 
further  sampling  once  they  were  identified  as  "inferior".  This 
elimination  is  referred  to  as  "taking  advantage  of  a  more  favorable 


configuration  (MFC)."  As  previously  mentioned.,  the  probability 
requirement  is  satisfied  even  if  the  population  mean6  are  in  an  LFC. 
It  is  clear  that  as  the  means  depart  from  the  LFC  to  yield  a  MFC,  a 
smaller  sample  size  will  suffice. 

The  Paulson  procedure  assuming  a  common  known  variance  is: 

1.  Select  X“  A */4  and  calculate 

a  =  l  02/(  A*  -X  )]  *  |  n((K  -  1)/(1-P*))  (2.1.31) 

X 

2.  Take  one  observation  from  each  population 

(X^p  X21,  ..«,  X^j).  Eliminate  any  population  ^  for 

which  Xp  <  max  {  Xp,  X21 . X^j  }  -  a  ^  ^  .  If 

all  but  one  population  is  eliminated,  select  it  as  the  best 
and  stop.  Otherwise  go  to  step  3. 

3.  Take  another  observation  from  each  population  not  eliminated 
in  step  2.  Proceeding  by  induction,  at  the 

rth  stage  we  eliminate  any  population  11  j  for  which 
r  r 

l  XJe  <  max  {£  X_,c:  all  remaining  v  }  -  a\  +  r  X  . 

s-1  16  s-1  8  (2.1.32) 

The  limit  on  r  equals  W  ^  ,  where  is  the  greatest  integer 

in  a,  /  X.  As  soon  as  K  -  1  populations  are  eliminated,  the 

A 

remaining  population  is  selected  as  best.  If  after  W  ^  stages 
there  is  more  than  one  population  remaining,  go  to  step  4. 

4.  The  experiment  is  terminated  at  stage  (W  +  1)  by  selecting 

population  i  for  which 


WX  +1 

I 

s  ”1 
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is  the  greatest.  Paulson  showed  that  the  probability  requirement 
(2.1.1)  is  satisfied  by  this  procedure  and  bv  a  similar  method  for  the 
case  of  common  unknown  o  .  Kleijnen  (1974)  reported  on  Monte  Carlo 
experiments  showing  that  Paulson's  procedure  performs  better  than  any 
other  comparable  single  stage  multi-stage,  or  sequential  procedure. 

Although  the  sequential  procedures  are  more  efficient  for  a 
A 

given  P  and  A  ,  their  application  by  simulators  has  been  limited. 
This  is  partially  due  to  the  fact  that  no  sequential  procedure 
addresses  the  problem  of  unknown  variances  or  correlated  observations; 
however,  the  main  problem  is  that  it  is  very  cumbersome  to  simulate 
several  systems  in  parallel. 

2.2  Initialization  Bias 

As  previously  mentioned  the  objective  of  many  computer 
simulation  experiments  is  to  select  the  best  alternative  operating 
policy  for  a  real-world  system  based  on  simulation-generated 
estimators  of  steady-state  performance  under  each  policy.  For 
example,  a  proposed  set  of  inventory  reorder  points  and  order 
quantities  may  be  used  as  decision  variables  for  a  model  of  an 
Inventory  system  with  a  particular  demand  distribution.  The  relative 
effectiveness  of  these  proposed  policies  can  then  be  measured  by 
comparing  the  simulated  average  monthly  costs.  In  such  a  case,  the 
initial  (starting)  conditions  (amount  on  hand,  amount  on  order)  can 
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seriously  affect  both  the  bias  and  the  variance  of  the 
simulation-generated  cost  estimators. 

Discrete-event  simulation  of  such  a  stochastic  system  requires 
that  starting  conditions  for  each  run  be  completely  specified. 
Ideally,  these  initial  conditions  should  be  randomly  selected  from  the 
equilibrium  state  probability  distribution  for  the  system.  However, 
an  experimenter  who  has  enough  information  to  do  this  has  no  need  to 
execute  the  simulation.  The  more  common  situation  is  that  the 
experimenter  has  some  basic  understanding  of  the  system  that  he  has 
garnered  from  past  testing  or  analysis.  Therefore,  he  must  pick  the 
most  realistic  initial  conditions  possible  based  on  his  a  priori 
knowledge  of  steady-state  system  operating  characteristics.  If  no 
reliable  information  is  available,  "empty  and  idle”  is  always  a 
possible  starting  state.  In  the  inventory  example,  this  corresponds 
to  an  empty  warehouse  with  no  stock  on  order.  Any  computer  simulation 
that  begins  with  such  a  sequence  of  unusual  events  —  that  is,  events 
having  a  low  probability  of  occurring  under  normal  operating 
conditions  —  will  generate  output  that  is  contaminated  by 
initialization  bias  (Schruben  1982).  This  initialization  bias  can  be 
a  major  source  of  error  in  estimating  a  steady-state  system 
performance  measure. 

Since  the  specified  purpose  of  our  simulation  experiments  is 
to  obtain  the  correct  sample  sizes  so  that  the  K  alternatives  can  be 
ranked  based  on  the  sample  means,  a  method  is  needed  to  eliminate  any 
bias  in  these  estimators  caused  by  improper  starting  conditions.  One 


method  to  overcome  this  Initialization  bias  problem  is  to  allow  a 
sufficiently  long  computer  run  so  that  the  initial  condition  effects 
are  negligible.  Even  though  these  effects  typicallv  decay 
geometrically,  convergence  to  steady-state  conditions  can  still  be 
quite  slow  (Conway,  1963).  Therefore,  such  a  method  can  be  costly  in 
that  the  required  sample  sizes  can  be  prohibitively  large. 

The  usual  method  of  controlling  simulation  initialization  bias 
is  to  allow  the  model  to  run  for  a  "warm-up"  period  before  output  data 
are  collected.  This  allows  those  observations  which  are  the  most 
"contaminated"  bv  the  choice  of  starting  conditions  to  be  discarded. 
As  a  consequence,  the  bias  of  the  estimated  steady-state  mean  response 
is  reduced.  This  procedure  is  referred  to  as  output  truncation,  and 
the  time  index  of  the  last  observation  to  be  discarded  is  called  the 
truncation  point. 

There  are,  however,  several  difficulties  with  truncating  data 
from  the  beginning  of  each  run.  If  too  few  observations  are 
truncated,  the  remaining  bias  adversely  affects  the  results. 
Discarding  an  excessive  amount  of  data  is  not  onlv  asteful  but  also 
increases  the  variance  of  cumulative  statistics  like  the  sample  mean. 

A  comprehensive  review  of  previously  proposed  "truncation 
rules"  Is  presented  by  Wilson  and  Pritsker  (1978a).  Many  of  these 
procedures  are  heuristic  rules  of  thumb  which  specify  the  truncation 
point  beyond  which  data  are  not  significantly  distorted  by  the  Initial 
conditions.  In  a  follow-up  paper,  Wilson  and  Pritsker  (1978b) 
developed  a  generalized  procedure  for  evaluating  startup  policies  with 
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associated  truncation  rules,  and  they  used  this  procedure  to  test  many 
of  the  methods  reported  in  their  first  paper.  They  specifically 
pointed  out  that  "The  truncation  rules  of  thumb  examined  in  this 
research  are  very  sensitive  to  parameter  misspecif ication,  and  their 
use  can  result  in  excessive  truncation". 

Before  considering  the  proper  way  to  select  a  truncation 
point,  we  must  first  determine  if  initialization  bias  is  present  in 
the  output  series  generated  by  a  simulation.  Schruben  (1979) 
developed  a  two-sided  statistical  test  for  the  presence  of 
initialization  bias  based  on  cumulative  sum  (cusum)  statistics.  He 
chose  the  cusum  statistic  because  of  it6  demonstrated  sensitivity  in 
industrial  quality  control  applications.  To  illustrate  cusum 
techniques,  consider  the  output  series  Xj,  ...,  Xn»  The  jth  cusum 
(S j)  is: 

j 

s,  -  l  (X.  -U  >  j  -  1,  2,  ...,  n  (2.2.1) 

J  i-1 

where  UQ  is  the  process  mean,  and  the  X^  are  independent  normal 
variates  with  E(X^)  ■  U  Q,  Var  (X^)  -  a  ^  so  that 

E(Sj)  -  0 
Var(S j)  -  j  °l 

There  are  three  problems  that  arise  in  the  application  of  cusum  tests 
to  determine  initialization  bias:  (1)  the  output  series  is  usually 
correlated;  (2)  the  process  mean,  U  0,  is  not  known;  and  (3)  the 
observations,  X^,  are  not  normally  distributed.  The  question  of  how 
to  address  correlated  data  is  addressed  first. 
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If  the  output  data  series  is  correlated  but  y  is  known,  it 

has  been  shown  that  the  normalized  cusum 

S°.  -  Sy(  0j1/2),  j  -  1,  2,  ....  n  (2.2.2) 

converges  in  distribution  to  standard  Brownian  motion  as 

n  — >  °°  (Schruben  1979).  In  this  case,  the  correlation  is  accounted 

2 

for  by  using  as  the  measure  of  the  variance,  0  ,  the  value 


2 

o 


00 


(2.2.3) 


where  y  denotes  the  autocovariance  at  lag  £: 


Y£  -  E  I(Xi  ~U  0)(X1+A  -V  Q)] 


(2.2.4) 


To  adapt  this  result  to  a  discrete-event  simulation  in  which 

2  2 
yQ  and  a  are  unknown,  Schruben  suggested  estimating  o  from  the 

portion  of  the  data  that  is  "safe"  from  the  effects  of  any  initial 

bias.  He  therefore  recommended  that  only  the  last  half  of  the  data  be 

2 

used  to  estimate  a  .  The  entire  output  series  is  grouped  Into  b 
equal-size  adjacent  and  nonoverlapping  batches  of  observations,  and 
the  series  of  batch  means  (X^  :  k  «  1,  ...,  b)  is  indexed  in  reverse 
order  so  that  Xj  and  X^  respectively  represent  the  last  and  first 
such  observations  generated  by  the  simulation.  There  are  s  ■  b/2 
"safe”  observations  (X^  s  k  ■  1,  ...,  s)  that  can  be  treated  as  1ID 

9 

normal  variates.  For  the  batch  mean  process,  the  parameter  o  is 
estimated  by 


(8  -  1) 


-1 


8 

E 

k-1 


(Xv  - 


V' 


(2.2.5) 


where 


S_1  Z  \ 
k-1 


is  Che  grand  mean  of  Che  "safe 
Since  U  is  unknown, 
test  statistic  (2.2.2). 

Let 


(2.2.6) 

”  data. 

Schruben  developed  an  alternative  to  the 


-1 


b 

Z 

k-1 


*k 


(2.2.7) 


£ 

Sf-  Z  (X.  -  xh),  1-1,  ...,  b,  (2.2.8) 

k-1 

S*  -  max  [  |St  /(b1/2  o)  I  :  2-1 . bj.  (2.2.9) 

Using  the  values  computed  from  equations  (2.2.5)  through  (2.2.9), 
Schruben  proved  that  in  the  absence  of  initialization  bias,  the  event 
S*  «  g(ot)  -  l-  0.5*  in(a/2)]1/2  (2.2.10) 

has  asymptotic  probability  1  -  a  as  b  — >  00  .  Thus  for  a 

prespecified  level,  a  .  of  Type  I  error,  equation  (2.2.10)  can  be  used 
to  construct  a  two-sided  statistical  test  for  initialization  bias  with 
rejection  of  the  hypothesis  of  insignificant  initialization  bias  when: 
S*  >  g(  a). 

The  most  recent  work  in  the  area  of  detecting  initialization 
bias  (Schruben  1982)  describes  a  one-sided  test  related  to  (2.2.9). 
It  should  be  noted  that  in  the  absence  of  initialization  bias,  the 
process  /(b5/?2  o  ):  £  -1,  ...»  b]  behaves  asymptoticallv  as  a 
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standard  Brownian  bridge  —  i.e.,  Brownian  motion  on  the  unit  interval 
conditioned  to  start  at  and  return  to  zero  Let  m  denote  the  value  of 
the  index  A  at  which  S  ^  attains  its  minimum,  and  let  t  *  m/b. 
Schruben  showed  that  if  no  initial  bias  is  present,  then  the  statistic 
g  -  CS^/b)/[3  t(l  -  t)]  (2.2.11) 

will  have  approximated  an  F  distribution  with  3  and  b/2  degrees  of 
freedom.  The  hypothesis  of  no  initialization  bias  is  rejected  if  the 

l 

computed  significance  probability  for  the  F-ratio  (2.2.11)  is  less 
than  a  prespecified  level  of  Type  1  error. 

Schruben  states  that  this  new  test  is  more  powerful  than  his 
previous  procedure  since  it  is  a  one-sided  test.  He  assumes  that  the 
user  is  looking  for  negative  initial  bias,  the  typical  case  for 
simulations  started  "empty  and  idle".  If  positive  bias  is  suspected, 
the  required  adjustment  is  to  multiply  the  data  by  -1  and  proceed  as 
before. 

In  this  same  article,  Schruben  presented  a  modification  to  the 
procedure  just  described  which  does  not  require  estimation  of  the 
scale  parameter  o^«  The  complete  procedure  is: 

1.  Compute  (2.2.11)  using  the  first  half  of  the  simulation  output 

data  and  set  ■  1;  call  the  result  §£. 

2.  Compute  (2.2.11)  using  the  last  half  of  the  simulation  output 

data  and  set  ■  1;  call  the  result  §£. 

3.  Let  Fj  j(l  -  a  )  denote  the  1  -  a  quantile  of  the 

F-distribution  with  3  and  3  degrees  of  freedom.  Reject  the 
hypothesis  of  no  negative  initialization  bias  if 
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g£/g  £  >  F3>3(1  -  o 0.  (2.2.12) 

Once  we  have  found  an  adequate  test  to  determine  If  a  sequence 
of  simulation-generated  data  has  Initial  bias,  there  is  still  the 
problem  of  how  much  data  to  delete  if  bias  is  found.  Such  a  situation 
is  addressed  by  Heldelberger  and  Welch  (1982).  Using  Schruben’s  test 
(2.2.10)  for  initialization  bias,  they  proposed  a  sequential 
truncation  procedure.  If  the  hypothesis  of  no  initial  bias  is 
rejected,  the  first  10%  of  the  data  is  deleted  and  the  test  is  rerun. 
They  found  that  no  severe  penalties  were  incurred  when  there  was  no 
initial  transient  (bias);  and  in  almost  all  cases  where  there  was 
bias,  the  truncated  sample  mean  provided  a  better  estimator  of  the 
steady-state  mean  than  the  untruncated  sample  mean. 

2.3  Normality 

As  previously  referenced,  Dudewicz  and  Zaino  have  developed 
the  onlv  multiple  ranking  procedure  that  handles  correlated  data; 
however,  this  procedure  still  requires  that  the  data  are  normally 
distributed.  Dudewicz  and  Zaino  lightly  pass  over  this  requirement  as 
if  it  were  one  that  occurs  routinely  in  discrete-event  simulations. 
In  actuality,  the  assumption  of  normality  is  frequently  violated. 

The  first  step  that  oust  be  addressed  when  trying  to  induce 
normality  is  an  adequate  statistical  test  for  normality.  Many  such 
tests  exist.  Fishman  (1978)  cites  numerous  studies  showing  the 
Shapiro-Wilk  (SW)  test  to  be  the  most  powerful  test  for  normality 
currently  available.  In  particular,  Shapiro,  Wilk  and  Chen  (1968) 
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found  that  the  SW  test  has  the  following  notable  properties: 

1.  It  is  the  most  sensitive  test  when  the  data  have  a  continuous, 
skewed,  long-tailed  distribution. 

2.  It  is  the  most  sensitive  test  when  the  data  have  a  continuous, 
skewed,  short-tailed  distribution. 

3.  It  is  one  of  the  four  most  sensitive  tests  when  the  data  have 
a  continuous,  symmetrical,  long-tailed  distribution. 

4.  It  is  one  of  the  two  most  sensitive  tests  when  the  data  have  a 
continuous,  symmetrical  short-tailed  distribution. 

5.  It  shares  second  place  with  another  test  when  the  true 
distribution  is  discrete. 

Here  sensitivity  is  measured  by  the  power  of  the  test,  which  is  the 
probability  of  rejecting  the  null  hypothesis  of  normality  when  in  fact 
the  sample  data  are  nonnormal. 

The  SW  test  (Shapiro  and  Wilk,  1965)  is  based  on  an  estimate 
of  the  squared  slope  of  the  regression  line  obtained  when  a  random 
sample  is  plotted  on  normal  probability  paper.  Under  conditions  of 
IID  normality,  this  quantity  is  an  estimate  of  the  population  variance 
multiplied  by  a  constant.  Nonnormality  usually  causes  this  quantity 
to  be  small  relative  to  the  corresponding  sample  variance.  To 
determine  the  SW  test  statistic,  W,  for  a  sample  size  n,  the  following 
steps  are  required: 

1.  Compute  m'  "  (m^,  m2,  ***,  a^),  the  vector  of  expected  values 
of  standard  normal  order  statistics  for  a  sample  of  size  n. 

2.  Compute  V  "  (v^  .),  the  corresponding  n  x  n  covariance  matrix 


.  ,  pjf. 
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for  standard  normal  order  statistics. 

3.  Compute  Y'  *  (Yj,  Yj,  ***,  Yn),  the  vector  of  ordered 

o 

observations  from  the  population  to  be  tested.  Let  (J  and  o 
respectively  denote  the  (unknown)  mean  and  variance  of  this 
population. 

4.  Let  Xj  ^  X2  ^  ^  XR  denote  the  corresponding  ordered  random 

sample  from  a  standard  normal  distribution. 

5.  If  the  Yj^  are  normallv  distributed,  then  we  have  the 
regression  equation  Y^  *  U  +  0  X^;  and  the  weighted 
least-squares  estimate  of  a  is 

m'  V*1  Y 

0  *  .  .  (2.3.1) 

m'  V"1  m 

^  /w 

With  the  definitions 

R2  -  m'  V-1  m  ,  (2.3.2) 

^  ^  A/ 

C2  -  m'  V*1  V-1  m  ,  (2.3.3) 

fv 

the  quantity 

b  -R2  O/C  (2.3.4) 

is,  up  to  the  normalizing  constant  C,  the  best  linear  unbiased 
estimate  of  the  slope  of  a  linear  regression  of  the  ordered 
observations,  Y^,  on  the  expected  values,  m^,  of  the  standard 
normal  order  statistics. 

2 

6.  The  usual  unbiased  estimate  of  (n-1)  0  is 

n 

SZ  -  I  (Y.  -  ?)Z  (2.3.5) 

i-1 

7.  The  W  test  statistic  is 
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W  - 


(2.3.6) 


where  (a)  the  distribution  of  W  depends  only  on  n,  (b)  the 
closer  W  is  to  unity  (its  maximal  value),  the  more  normal  the 
data  appear. 

Since  the  m'  vector  is  known  for  a  given  n,  Shapiro  and  Wilk 
were  able  to  simplify  the  calculation  of  b  b»  tabulating  values  of  a 
coefficient,  an-i+l»  which  is  used  in  their  recommended  test 
procedure. 

1.  Order  the  observations: 


v<  Y2  ,<  s<  Yn 


2.  Compute 


3. 


n 

S2  «  r  (Y±  -  Y)2 
i-1 

If  n  Is  even,  set  j  ■  n/2;  otherwise  set  j  ■  (n-l)/2. 
Compute 


J 

b  “  2  an-i+l  ^Yn-i+l  ~  YiJ 

i-1 


where  values  of  an_j+i  are  given  In  Shapiro  and  Wilk  (1965). 

4.  Compute  W  ■  b2/S2. 

5.  The  1,  2,  5,  10,  50,  90,  95,  98,  and  99  per  cent  points  of  the 
distribution  of  W  are  given  in  Shapiro  and  Wilk  (1965).  Small 
values  of  W  are  significant,  i.e.  indicate  non-normality. 

An  import  ..t  Improvement  to  this  procedure  was  presented  by 


Shapiro  and  Francla  (1972)  when  they  formulated  a  similar  test 
statistic,  W,  for  sarcple  sizes  up  to  400.  Weisberg  and  Bingham 
(1975)  published  a  computing  formula  for  a  test  statistic,  W',  which 
they  showed  to  be  asymptotically  equivalent  to  the  two  previous  test 
statistics.  This  formula  enables  the  calculation  of  the  Shapiro  and 
Wilk  test  statistic  for  any  sample  size. 

2.4  Spectral  Analysis  of  Simulation  Data 

Many  authors  have  noted  that  in  general,  the  data  generated  by 
computer  simulation  experiments  are  highly  autocorrelated  (Naylor  et 
al.  1966;  Law  and  Kelton  1982;  Heidelberger  and  Welch  1981a).  Yet 
classical  statistical  theory  for  estimating  the  variance  of  cumulative 
statistics  like  the  sample  mean  is  based  on  the  assumption  that  the 
observations  are  independent  and  identically  distributed.  In  many 
simulation  experiments,  the  autocorrelation  present  in  output  series 
of  interest  causes  classical  statistical  techniques  to  yield 
substantial  underestimates  of  the  variance  of  relevant  cumulative 
statistics  (Naylor,  Wertz,  and  Wonnacott  1969).  Use  of  such 
underestimates  when  calculating  confidence  intervals  around  the  sample 
mean,  for  example,  will  cause  unrealistically  narrow  intervals.  One 
way  to  adequately  account  for  autocorrelation  is  by  batching  the 
observations  so  that  the  resulting  batch  means  are  approximately 
normal  and  uncorrelated  (and  hence  independent);  see  Law  and  Kelton 
(1982).  Another  method  is  to  replicate  the  simulation  experiment  and 
compute  the  variance  across  replications;  see  Fishman  (1978).  The 
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regenerative  method  of  analysis  (Law  and  Kelton  1982)  organizes  the 
observations  from  a  single  run  into  cycles  that  are  exactly  IID;  a 
steady-state  performance  estimator  is  then  based  on  the  ratio  of 
relevant  cycle  measurements  that  have  been  averaged  over  all 
regenerative  cycles  observed  during  the  run* 

All  of  these  methods  for  simulation  analysis  have  serious 
drawbacks*  Fishman  and  Kiviat  (1967  )  have  noted  that  in 
implementations  of  the  method  of  batch  means,  procedures  for 
determining  the  batch  size  "seem  to  have  neither  enough  prior  nor 
posterior  justification  in  most  cases  to  make  a  choice  that  is  much 
more  than  arbitrary."  Initialization  bias  is  the  main  problem 
connected  with  the  method  of  Independent  replications.  In  the  case  of 
regenerative  analysis,  regeneration  frequencv  is  the  issue:  in  most 
real-world  models,  the  time  intervals  between  successive  regeneration 
epochs  are  ouch  too  large  to  allow  an  adequate  number  of  regenerative 
cycles  to  be  completed  within  a  feasible  run  length.  An  alternative 
estimation  procedure  which  avoids  all  of  these  difficulties  can  be 
based  on  spectral  analysis  (Brllllnger  1975). 

The  spectral  method  used  in  this  research  to  estimate  the 
variance  of  the  sample  mean  was  developed  by  Heidelberger  and  Welch 
(1981a).  By  working  with  the  periodogram  of  a  simulation-generated 
time  series,  they  converted  the  problem  of  dealing  with  the  original 
autocorrelated  series  into  the  more  tractable  problem  of  fitting  an 
appropriate  curve  to  the  uncorrelated  observations  that  constitute  the 
periodogram.  Heidelberger  and  Welch  assumed  that  the  series  (X^,  ..., 
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xN)  is  a  sample  from  a  covariance  stationary  process  with  mean  jx  and 
lag-k  autocovariance  Y^Ck  *  0,  ^1,  *2,  ...)  such  that 

OO 

I  |Yk  I  <  00  •  (2.4.1) 

k  »  -  00 

This  ensures  the  existence  of  the  spectral  density 

OO 

p(f)  =  Z  Yk  cos  (2TTfk).  (2.4.2) 

k  “  -  oo 

As  an  estimator  of  p  ,  the  sample  mean  has  variance 

N-l 

Var(XN)  -  N  1  £  (l-|k|/N)Y.;  (2.4.3) 

k  -  -(N-l) 

and  in  view  of  (2.4.1)  and  (2.4.2),  we  have 

OO 

lim  N*Var(X«)  -  Z  Y .  -  p{0).  (2.4.4) 

N  — >  oo  K  -  -  oo 

The  spectral  method  of  simulation  analysis  uses  the  large-sample 
approximation 

Var(XN)  -  p(0)/N,  (2.4.3) 

so  that  it  is  only  necessarv  to  estimate  the  spectral  density  at  zero 
frequency. 

Heidelberger  and  Welch  noted  that  the  usual  methods  of 
spectral  estimation  (Jenkins  and  Watts  1968,  Bloomfield  1976)  are  not 
appropriate  for  estimating  the  spectrum  at  zero  frequency.  Such 
methods  use  a  spectral  window  H(f)  so  that  the  estimator  P(f*)  at  a 
particular  frequency  f*  has  for  its  expected  value  a  weighted  average 
of  the  spectrum  p(f)  in  a  neighborhood  of  f*: 
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E[p"(f‘)l  -  J  H(f  -  f*)  p(f)  df  (2.4.6) 

-1/2 

Now  the  spectrum  has  a  local  optimum  at  f*  ■  0;  and  in  many  queueing 
simulations  the  spectrum  is  sharplv  peaked  at  zero  frequencv. 
Equation  (2.4.6)  shows  that  in  such  a  situation,  a  classical  estimator 
p(0)  has  a  large  negative  bias.  To  reduce  the  bias  of  p(0),  we  nust 
use  a  narrow  window.  Unfortunately  the  variance  of  any  estimate  of 
p(0)  increases  as  the  width  of  the  window  decreases.  Thus  classical 
methods  of  spectral  estimation  yield  either  a  highly  variable 
estimator  of  p(0)  which  is  approximately  unbiased,  or  a  stable 

estimator  which  is  strongly  biased.  Duket  and  Pritsker  (1978) 
investigated  these  problems  experimentally  for  the  queue  length 

process  in  a  single-server  queue  with  exponential  interarrival  and 
service  times. 

Heidelberger  and  Welch  developed  the  following  procedure  to 
overcome  the  problems  of  classical  spectral  estimation: 

1.  Calculate  the  periodogram 

N 

I(n/N)  -  N"1  l  X^expl-2  7Ti(j-l)(n-l)/N]  I  2  (2.4.7) 

j-1  J 

for  n  ■  1,  ...,  2K,  where  i  ■  (-l)^2  and  K  m  N/4. 

2.  Calculate  the  logarithm  of  the  "smoothed"  periodogram: 

fn  -  (4n-l)/(2N),  (2.4.8) 

and 

J(fn)  -  log!  (  I[(2n-1)/N]  +  I[2n/N]  )/2  ]  (2.4.9) 

for  n  ■  1,  ...,  K. 
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3.  Using  ordinary  least-squares,  fit  a  polynomial  of  degree  d 


8(fn) 


d 

I 

k-0 


Z  ak  fn 


(2.4.10) 


to  the  function  J(fn)  +  0.270 


for  n-1 ,  ...,  K. 

4.  Using  the  least-squares  estimate  £q  and  the  design  matrix 


-1 


'f"1 


(2.4.11) 


1  AK  J 

associated  with  the  regression  (2.4.10),  compute  the  quantity 

C^K.d)  -  exp  (-0.3225[(X'X)-1]11)  (2.4.12) 

in  order  to  obtain  the  approximated  unbiased  estimator 


p(0)  -  C1(K,d)*exp(a0)  (2.4.13) 

for  the  spectrum  at  zero  frequency. 

The  regression  (step  3)  provides  the  stability  of  averaging  over  a 
number  of  perlodogram  values,  and  the  flexibility  of  the  family  of 
fitted  functions  avoids  the  bias  associated  with  the  spectral  window. 
The  advantage  of  operating  in  the  frequencv  domain  versus  the  time 
domain  is  shown  bv  the  fact  that 


Cov[J(fm),  J(fn)]  =0,  m  n.  (2.4.14) 

Batching  the  perlodogram  into  batches  of  size  2  and  taking  the 
logarithm  of  the  batch  means  (see  equation  (2.4.9))  is  intended  to 
stabilize  the  variance  of  the  perlodogram  so  that  ordinary 
least-squares  can  be  used  to  fit  the  polynomial  in  step  3.  In  a 
subsequent  article,  Heldelberger  and  Welch  (1981b)  found  that  using  a 
polynomial,  of  degree  d  •  2  in  (2.4.10)  provides  the  best  trade-off 
between  the  bias  and  the  variance  of  p(0). 
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CHAPTER  III 


DEVELOPMENT  OF  THE  MULTIPLE  RANKING  PROCEDURE 

3. 1  Introduction 

To  develop  a  multiple  ranking  procedure  that  can  handle 
simulation-generated  time  series  characterized  bv  initialization  bias, 
unknown  autocovariance  structures,  and  nonnormality,  appropriate 
algorithms  were  developed  for  each  aspect  of  the  problem.  In 
particular,  separate  support  routines  were  designed  to  perform  the 
following  operations  on  such  data  sets: 

1.  Induce  normality  by  adequate  batching 

2.  Eliminate  initialization  bias  with  a  cusum  test 

3.  Compute  the  final  sample  size  with  an  “Stimate  of  the  spectrum 
at  zero  frequency  replacing  the  sample  variance  in  the 
Dudewicz-Dalal  formula. 

The  organization  of  this  chapter  reflects  this  three-way 
division  of  the  overall  problem.  The  section  devoted  to  each 
subproblem  includes  the  appropriate  theoretical  development,  a  program 
description,  and  a  summary  of  the  procedures  used  in  the  verification 
and  validation  of  the  algorithm.  A  final  section  describes  the 
integration  of  these  routines  into  the  complete  MRP  adapted  to 
discrete-event  simulation. 
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3.2  Normality  Test  Procedure 

3. 2. 1  Development 

A  stand-alone  computer  program  written  by  De  Branges  (1974) 
was  used  as  the  foundation  for  building  a  support  routine  to  perform 
the  Shapiro-Wilk  normality  test  at  a  user-specified  level  of 
significance.  The  program,  WILK,  determines  the  batch  size,  NSIZE, 
required  to  induce  an  acceptable  degree  of  convergence  to  normality  in 
the  data  produced  by  a  discrete-event  simulation.  The  original 
program  by  De  Branges  required  extensive  modification  to  eliminate 
extraneous  calculations  and  to  allow  the  inclusion  of  repeated  testing 
on  increasingly  larger  batch  sizes. 

WILK  uses  an  array  containing  data  from  up  to  16  replications 
of  the  simulation  to  be  examined,  where  each  independent  replication 
generates  up  to  100  data  points.  The  replication  count,  r,  and  the 
sample  size,  nQ,  within  each  replication  are  selected  by  the  simulator 
prior  to  execution.  The  series 

(Xtj  :  i  -  1,  ...»  r  and  j  -  1,  ...»  nQ) 
is  first  tested  for  normality  at  the  a  ■  0. 1  level  of  significance  by 
computing  batch  means  across  batches  of  size  NSIZE: 

NSIZE 

Xj (NSIZE)  -  (NSIZE)-1  i  X,  ,,  i  -  1 . .  (3.1.1) 

J-l  J 

starting  with  NSIZE  ■  1.  The  composite  hypothesis  tested  is: 

Hq(NSIZE):  {  (NSIZE )  1  {  i  «  r  }~IID  N( U  , 0  2)  (3.1.2) 

for  some  U  and  o 

If  HQ (NSIZE)  is  rejected,  the  value  of  NSIZE  is  increased  by  one  and 
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(3.1.2)  is  tested  again;  otherwise  the  value  of  NSIZE  is  returned  for 
use  by  other  parts  of  the  analysis  program.  If  the  test  for  normality 
is  rejected  when  NSIZE  equals  NMAX  (NMAX  ■  3  by  default),  WILK  reports 
back  to  the  user  that  convergence  to  normality  is  not  achieved.  The 
user  has  the  option  to  either  increase  the  number  of  replications  or 
the  run  length.  Figure  3.1  provides  a  flowchart  of  WILK.  A  listing 
of  the  program,  WILK,  is  presented  in  Appendix  A. 

3.2.2  Verification  and  Validation 

The  program  to  perform  the  Shapiro-Wilk  test  for  normality  was 
used  to  test  three  data  sets  that  had  been  previously  tested  by  the 
original  De  Branges  program.  In  each  case,  with  NSIZE  set  equal  to  1, 
identical  results  were  obtained. 

Several  highly  correlated  data  sets  were  also  generated  and 
passed  to  WILK  in  order  to  test  the  operation  of  the  batching 
procedure.  A  variety  of  stationary  autoregressive-moving  average 
processes  were  generated  by  the  support  routine  ARMAPQ  (Hoffman  1982) 
for  use  in  this  phase  of  the  program  verification.  Table  3.1 
summarizes  the  results  produced  by  WILK.  The  same  test  sequences, 
both  original  data  and  batched  data,  were  also  tested  by  the  original 
De  Branges  program  and  identical  results  were  obtained 

3.3  Initialization  Bias  Test  Procedure 

3. 3. 1  Development 

The  initialization  bias  (IB)  detection  routine  is  designed  to 


1  Program  WILK  Flowchart 


Table  3.1  Results  of  testing  subprogram  WILK 
with  ARMA  (p,q)  processes. 


AR 

MA 

MEAN 

WHITE  NOISE 

PARAMETERS 

PARAMETERS 

U 

VARIANCE  O2 

-  0.35,  0.25 

• 

100 

400 

0.35,  0.25 

• 

100 

400 

0.65,  0.25 

« 

o 

O 

400 

0.65,  0.25 

• 

100 

25 

0.75,  0.75 

• 

50 

400 

-  0.8 

• 

50 

100 

0. 85 

• 

50 

100 

• 

0.35 

50 

100 

• 

0.6 

10 

25 

• 

0.4,  0.4 

10 

25 

• 

0.25,  -  0.75 

100 

100 

• 

-  0.6,  0.4 

25 

49 

0.4 

0.4 

25 

49 

-  0.2 

0.8 

100 

100 
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test  the  output  sequence  from  a  discrete-event  simulation  after  the 
sequence  has  been  hatched  to  achieve  normality  using  program  W1LK.  It 
is  the  responsibility  of  the  user  to  specify  the  level  of  Type  1  error 
appropriate  for  his  needs. 

As  discussed  in  the  literature  review,  the  most  appealing 
method  is  Schruben's  one-sided  test  (2.2.12)  for  negative  IB  that  does 
not  require  an  estimate  of  the  process  variance  parameter  (2.2.3). 
Its  sensitivity  and  its  independence  of  the  underlying  covariance 
structure  make  this  test  substantially  more  effective  than  any  other 
available  technique.  Once  this  procedure  had  been  coded,  an 
experiment  was  performed  with  six  data  sets  having  each  of  the 
following  characteristics: 

1.  Negative  bias 

2.  Positive  bias 

3.  A  damped  oscillation  between  negative  and  positive  bias 

4.  Negative  bias  not  reaching  stationarity 

5.  Positive  bias  not  reaching  stationarity 

6.  No  initial  bias. 

Figure  3.2  shows  the  graphs  of  each  data  set.  The  program  includes  a 
routine  to  Identify  positive  bias  and  to  account  for  it  by  reversing 
the  sign  of  all  observations. 

The  program  performed  well  for  data  sets  1,  2,  4,  5,  and  6  in 
that  each  occurrence  of  Initial  bias  was  detected  and  an  intuitively 
reasonable  truncation  point  was  specified.  However,  the  program 
failed  when  data  set  3  was  tested.  The  problem  was  found  to  be  that 


the  ratio  g^/g^  of  maximum  squared  cusums  respectively  computed  from 
the  first  half  and  last  halves  of  the  data  fails  to  detect  significant 
bias  when  the  two  optima  occur  on  opposite  sides  of  the  mean*  Because 
the  test  procedure  involves  squaring  the  maximum  cusum  values,  the 
signs  of  these  deviations  from  the  mean  are  lost*  It  is  unclear  how 
to  modify  the  test  statistic  gf/gjj,  to  handle  this  type  of  transient 
behavior. 

As  an  alternative  to  the  test  statistic  gf/g^  .  we  coded 

Schruben's  other  one-sided  statistic  g  defined  by  equation  (2.2.11). 

2 

The  parameter  a  for  the  batch  mean  process  defined  by  (2.2.3)  is 
estimated  bv  computing  the  sample  variance,  Vg,  of  the  "safe"  batch 
means  using  equation  (2.2.5).  The  lag-one  correlation  between  the 
"safe"  batch  means 


~  8-1  _  _ 
P1"VS2  Ms-ir1  I  (XA  -  Xs)(Xi+1  -  Xs) 
i“l 

is  then  used  to  yield  the  final  parameter  estimate 


(3.3.1) 


a 2  *  *[(1  +  px)/(l  -  0j)J  (3.3.2) 

for  the  cusum  test. 

The  motivation  for  (3.3.2)  closelv  parallels  the  analysis 
given  by  Dudewicz  and  Zaino  (1977):  in  effect  we  are  modeling  the 
"safe"  batch  means  as  an  autoregressive  process  of  order  one  so  that  a 

9 

simple  formula  for  0  can  be  applied.  Only  the  first-order 


autoregressive  effect  is  considered  because  it  is  equally  important  to 
detect  actual  initialization  bias  (i.e.,  to  avoid  Type  II  error)  as  it 
is  important  to  avoid  falsely  detecting  nonexistent  bias  (i.e.,  to 
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avoid  Type  I  error).  Therefore,  we  judged  that  it  i6  better  to 
2 

underestimate  o  by  using  only  lag  1  effects  in  (3.3.2)  than  to 

2 

possibly  overestimate  a  using  higher-order  effects.  Completely 
ignoring  these  effects  was  considered  to  be  too  gross  an 
underestimation.  This  same  reasoning  forms  the  basis  for  ignoring  any 
negative  autocorrelation. 

The  modified  initialization  bias  test  procedure  based  on 
(2.2.11)  and  (3.3.2)  was  applied  to  the  six  data  sets  depicted  in 
Figure  3.2.  In  each  case,  the  modified  test  correctly  identified  the 
presence  of  bias. 

In  correcting  for  the  effects  of  initialization  bias,  the  next 
step  is  to  determine  a  suitable  truncation  point.  This  is 

accomplished  by  successively  deleting  blocks  equal  to  10%  of  the 
original  data  set  until  the  remaining  series  finally  yields  a 
nonsignificant  value  for  the  test  statistic.  As  in  the  experiments 
reported  by  Heidelberger  and  Welch  (1982),  the  truncation  procedure  is 
stopped  if  50%  of  the  original  data  set  has  been  truncated  and  the 
bias  effects  have  still  not  been  eliminated.  Use  of  this  limit  is 
reinforced  by  the  fact  that  the  50%  point  is  used  as  the  point  where 
the  "safe"  data  starts. 

During  the  testing  of  data  set  3  (Figure  3.2),  disturbing 
results  were  obtained.  Specifically,  the  test  forced  the  leading  10% 
of  the  data  to  be  truncated;  but  then  a  test  on  the  remaining  data 
points  failed  to  produce  a  significant  result.  Figure  3.3  reveals 
marked  transient  behavior  in  the  remaining  time  series.  This  casts 


JW. 


some  doubc  on  Che  adequacy  of  any  one-sided  test  for  initialization 
bias  in  the  presence  of  nonmonotonic  transients. 


Figure  3.3  Truncation  point  determined  by  one-sided  cusum  test. 

The  intermediate  results  generated  during  the  test  were 
checked  by  hand,  and  a  serious  inadequacy  was  found.  Namely,  the 
procedure  only  checks  for  deviations  from  the  mean  in  one  direction. 
This  fact  clearly  6hows  that  Schruben's  procedure  only  applies  to 
monotonically  decreasing  transients.  To  accommodate  the  possibility 
of  nonmonotonic  transients,  it  was  necessary  to  develop  a  two-sided 
procedure.  Such  a  procedure  will  be  less  powerful  than  the 

corresponding  one-sided  test  when  the  transient  mean  function  lies 
entirely  on  one  side  of  the  steady-state  mean,  but  a  two-sided  test  is 
necessarv  to  handle  the  transients  that  frequently  occur  in  queueing 
simulations. 


Replacing  the  minimum  cusum  value  in  (2.2.11)  with  the  maximum 
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absolute  cusum, 

S**  ■  max  t  |  Sj  I  :  1  ^  j  ^  b  )  (3.3.3) 

K**  *  min  {j  :  I  Sj  I  ■>  S**  }  (3.3.4) 

yields  a  variant  of  Schruben’s  two-sided  test  procedure  that  avoids 
the  problems  encountered  in  the  previous  techniques.  This  was 
corroborated  when  the  two-sided  test  was  coded  and  applied  to  the  6 
data  sets  shown  in  Figure  3.2.  Using  the  automatic  truncation  routine 
previously  described,  we  obtained  favorable  results.  The  troublesome 
properties  exhibited  by  data  set  3  were  identified,  and  a  reasonable 
truncation  point  was  reported.  Once  a  robust  procedure  for  initial 
bias  detection  was  found  that  would  accept  a  complete  range  of 
possible  inputs,  it  was  decided  to  see  if  any  of  the  desirable 
features  of  the  previously  rejected  approaches  could  be  incorporated 
into  the  final  product. 

Since  the  purpose  of  the  test  procedure  is  to  identify  and 
eliminate  initial  bias,  we  considered  standardizing  the  two-sided  test 
statistic  so  that  it  has  the  same  asymptotic  distribution  as  the 
absolute  maximum  of  a  Brownian  bridge  process: 

B**  -  S**/(  SU**(l-t**)]l/2)  (3.3.5) 

where 

t**  .  K**/b.  (3.3.6) 

Unfortunately  the  joint  distribution  of  t**  and  B**  is  not  known  for  a 
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inequality: 

1.  Find  S+  and  S~, 


the  maximum  and  minimum  values  of  the  cusum 


S.  -  b~1/2  I  (X.  -  X^,  k  =  1 . .  (3.3.7) 

j-1  J 

together  with  the  corresponding  indices  K+,  K-  where  the 


maximum  and  minimum  respectively  occur. 

2.  If  S+  or  S  equals  zero  (indicating  cusums  of  onlv  one  sign), 


set 

S  -  max  {  S',  S+  },  (3.3.8) 

and  proceed  to  the  previously  given  one-sided  test  (2.2.11). 
Otherwise  go  to  step  3. 

3.  Compute  Q 2  by  equations  (3.3.1)  and  (3.3.2). 

4.  Set  v>  the  number  of  degrees  of  freedom,  equal  to  (b-1), 
where  b  is  the  number  of  batches. 


5.  Set  t+  -  K+/b  and  t  - 

K"/b. 

6.  Compute 

g+-  (S+)2  / [3 

8 2  t+(l-t+)] 

(3.3.9) 

g'  -  (S')2  / [3 

a2  t'(l-t')] 

(3.3.10) 

7.  Use  the  IMSL  routine  MDFDRE  to  determine  the  significance 


probabilities. 

a+  -  Pr  {  F3>v  >  g+  }  (3.3.11) 

a'  -  Pr  {  F3>v  >  g"  }  (3.3.12) 

8.  Reject  a  hypothesis  of  no  bias  at  the  a  level  of  significance 
if: 

ain(  a“,  a+)  <  a/2.  (3.3.13) 


iV\ 


A 
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In  this  two-sided  test,  the  maximum  prespecified  level  of  Type 
I  error,  a  ,  is  maintained  by  performing  2  complimentary  one-sided 
tests  each  at  significance  level  a/2.  This  modification  will 
ultimately  result  in  a  somewhat  larger  sample  size  than  would  be 
required  by  a  test  with  size  exactly  equal  to  a  (Bowker  and  Lieberman 
1972).  The  validity  of  rejecting  the  null  hypothesis  of  no  bias 

Hq:  E[X.]  -  U,  i  «  1,  ...»  b  (3.3.14) 

when  min  (  a  ,  a+)  <  a/2  is  based  on  the  following  conditional 

Bonferroni  inequality: 

Pr  {  Accept  Hq  |  HQ  }  -  Pr  {  min(a  ”,  a  +)  >  a  /2  |  Hq  } 

*  Pr  {  a”  >,  a/2  and  a+  >,  a/2  |  HQ  } 

>,  1  -  Pr  {  a  '  >,  a  /2  |  H0  } 

-Pr{  a+>,a/2  |  H0  } 

=  1  -  a  (3.3.15) 

As  mentioned  earlier,  the  data  sequence  (Xj:  i  ■  1,  ...,  b) 
tested  by  the  IB  detection  routine  was  formed  by  taking  the  mean  value 
of  NSIZE  original  data  points  i.e. 

i*NSIZE 

X,  -  (NSIZE)”1  I  X.  ,  i  -  1 . b  -  n  /NSIZE  (3.3.16) 

k-(i-l)*NSIZE  +1 

This  batching  was  found  to  have  no  effect  on  identification  of 
initialization  bias. 

Initially  the  truncation  point  was  chosen  arbitrarily  at  the 
0.1  *  b  data  point  (b  ■  number  of  batches).  Since  the  IB  test 
procedure  specifically  identifies  an  epoch  beyond  which  the  null 
hypothesis  Is  accepted,  the  truncation  of  the  data  at  that  particular 
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point  is  more  reasonable  than  deleting  10Z  of  the  data.  If  a 
two-sided  test  is  necessary,  then  K+  is  used  for  a  truncation  point 
when  a+  <  a/2,  and  K  is  used  when  oT  <  a/2.  When  both  a+  and  a 
are  less  than  a/2,  Che  larger  of  K+  and  K~  determines  the  truncation 
point. 

While  working  on  subsequent  stages  of  the  dissertation,  we 

2 

discovered  a  superior  method  for  estimating  the  variance  parameter  o 
of  a  correlated  data  sequence.  (See  section  3.4.3).  Note  that  o  is 
just  the  spectrum  at  zero  frequency  p(0)  for  the  batch  mean  process 
(3.3.16).  Thus  the  spectral  analysis  routine,  WELCH,  is  used  in  place 
of  equations  (3.3.1)  and  (3.3.2)  in  the  final  version  of  the 
initialization  bias  detection  routine,  IBZERO.  A  listing  of  1BZER0  is 
included  in  Appendix  B.  A  flowchart  of  IBZERO  is  shown  in  Figure  3.4. 

3.3.2  Verification  and  Validation 

The  data  used  during  the  development  of  the  initialization 
bias  detection  program,  IBTEST,  were  also  used  to  test  the  final 

version  of  the  program,  IBZERO.  As  noted  previously,  IBZERO  estimates 

2 

the  process  variance  parameter,  a  ,  by  estimating  the  spectral 
density  at  zero  frequency.  Table  3.2  compares  the  results  of  IBTEST 
and  IBZERO.  In  the  cases  where  50Z  of  the  data  was  truncated  and  the 
remaining  series  still  showed  the  effects  of  initial  bias  (data  sets  4 
and  5),  the  user  was  given  the  warning  message  that  a  larger  sample 
size  would  be  required  to  eliminate  initial  bias  effects. 

Additional  data  sets  were  generated  using  the 
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INITIALIZE  NSIZE  NSTART 
READ  DATA (OBS)  ALPHA,  DATA 
NUMBAT:  -  OBS/NSIZE 


LENTH := NUMBAT 


QSUM 


// 

// 

// 

// 

// 

// 

// 


FOR  I:  -  1,  NUMBAT 


// 

// 

// 


FOR  J  -  NSTART,  NFIN 


BATSUM:  -  BATSUM  +  DATA(J) 


NSTART  -  NSTART  +  NSIZE 
NFIN  -  NFIN  +  NSIZE 
BATCH(I):  -  BATUM/NSIZE 
(WELCH  ( BATCH , ZERO?) 


n 

n 

n 

U 

// 

// 


FOR  K  -  1,  NUMBAT 

COMPUTE  CUSUM  (K) 


STANDARDIZE  CUSUM  TO  UNIT  INTERVAL 


SAVE  VALUE  AND  LOCATION  OF 
LARGEST  AND  SMALLEST  CUSUM 


Figure  3. A  Flowchart  of  initialization  bias  test  procedure  IBZERO 


NUMBAT 


NUMBAT  -K 


REPORT  RESULTS:  TOO 
MUCH  TRUNCATION 
STOP 


NUMBAT  <  .5  *  LENGTH _ 

NSTART :■  NSTART  +  K 


- >  QSUM 


NO 

X  1  -  P-  .AND. 

1  -  P+  >  HALPHA 

PRINT  NUMBAT 

- >  YES 

STOP 

A 


WELCH 

Subroutine  to  estimate 
variance  by  spectral 


mdfdre 

IMSL  subroutine  computes 
significance  probability 
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Table  3.2  Performance  comparison  for  Che  daca-Cruncaton 
procedures  1BTEST  and  1BZERO. 


DATA  SET  PROCEDURE  TRUNCATION  ESTIMATE  OF  ESTIMATE 


POINT 

P 

OF  o2 

1 

IBTEST 

26 

11.05 

0.32 

1 

IBZERO 

26 

11.05 

0.31 

2 

IBTEST 

19 

35.39 

2.12 

2 

IBZERO 

19 

35.39 

1.94 

3 

IBTEST 

49 

10.18 

0.036 

3 

IBZERO 

40 

10.12 

0.019 

m 

IBTEST 

DID 

NOT 

REACH 

20.4 

IBZERO 

STATIONARITY 

4.7 

5 

IBTEST 

DID 

NOT 

REACH 

918 

5 

IBZERO 

STATIONARITY 
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autoregressive-moving  average  process  generator  ARMAPQ.  Each  series 
was  generated  with  a  zero  mean;  then  various  types  of  IB  were 
superimposed  by  adding  a  transient  mean  function.  Each  sequence  was 
finally  tested  by  IBZERO.  To  show  graphically  the  transient  behavior 
of  the  input  series  as  well  as  the  cusum  values  used  during  the  test, 
a  plot  routine  was  written  and  incorporated  into  IBZERO. 

Figures  3.5  thru  3.8  show  the  results  of  testing  such  a 
sequence.  The  test  series  is  the  same  one  used  to  test  program  WILK. 
Figure  3.5  shows  the  results  of  the  interactive  terminal  session  in 
which  IBZERO  was  used  to  determine  a  truncation  point  for  the  series. 
Figure  3.6  is  a  plot  of  the  batch  means.  For  this  test  the  batch 
size,  NSIZE,  was  set  equal  to  three.  Therefore  the  requested  test  of 
120  original  data  points  resulted  in  a  test  of  40  batch  means.  Figure 
3.7  shows  the  plot  of  the  cusum  produced  by  the  40  batch  means.  This 
figure  displays  the  early  peak  that  is  characteristic  of  negative 
initial  bias. 

Based  on  the  peak  of  the  cusum  occurlng  at  batch  number  6,  the 
leading  18  observations  of  the  original  series  were  deleted  (note  that 
6*NSIZE  ■  18  when  NSIZE  “3).  A  subsequent  test  on  the  remaining 
data.  Figure  3.8,  showed  that  there  was  no  pronounced  early  peak;  and 
the  hypothesis  of  no  initial  bias  was  accepted.  It  should  be  noted 
that  the  graphs  in  Figures  3.7  and  3.8  have  different  scales.  Before 
the  IB  was  eliminated,  the  cusum  varied  from  2.0  to  -2.2  (see  Figure 
3.7).  After  deletion  of  the  transient  observations,  the  cusum  fell  in 
the  range  0.6,  -0.2  (see  Figure  3.8).  Since  a  fluctuating  initial 
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ENTER  THE  NUMBER  OF  DATA  POINTS 

<  120  > 

ALPHA  *= 

<  0. 1  > 

DO  YOU  WANT  TO  RERUN  WITH  A  DIFFERENT  LEVEL  OF  SIGNIFICANCE? 

ENTER  0  FOR  NO 
ENTER  1  FOR  YES 

<  0  > 

TEST  COMPLETE 

Figure  3.5  Interactive  session  for  testing 
transient  AR(1)  series  tested  by  procedure  IBZERO. 
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PLOT  OF  BATCH  MEANS 


Figure  3.6  Transient  AR(1)  series  tested  by  IBZERO. 
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Figure  3.7  CUSUM 


for  transient  AR(1)  series  tested  by  IBZERO 
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HYPOTHESIS  OF  NO  INI  I AL I ZAT ION  BIAS  IS  NOT  REJECTED  AT  SPECIFIED 
LEVEL  OF  SIGNIFICANCE  .1000  WITH  A  TRUNCATION  POINT  OF  13 

MEAN  OF  RAW  DATA  =  105. *1267 

MEAN  OF  THE  TRUNCATED  DATA  =  98.7201 


Figure  3.8  CUSUM  for  AR(1)  series  truncated  by  IBZERO 


bias  was  found  in  this  particular  example,  the  more  powerful  one-sided 
IB  test  could  not  have  been  used. 

3.4  Multiple  Ranking  Procedure  for  Correlated  Processes 
3.4.1  Extension  of  Dudewicz-Dalal  Procedure 

As  shown  in  Section  2.1.2,  previous  attempts  to  develop 
multiple  ranking  procedures  for  correlated  processes  have  been 
restricted  in  scope  to  simple  autoregressive  processes  of  order  one. 
Unfortunately,  a  large  number  of  simulation-generated  processes  which 
can  be  modeled  by  time  series  do  not  fit  this  convenient  AR(1)  form. 
To  characterize  such  a  process  (Zfc:  t  “  1,  2,  ...)  adequately  may 
require  the  introduction  of: 

1.  Higher-order  autoregressive  terms  in,  say,  an  AR(p)  model 

zt  "  MZ  +  Wi  -  M  Z>  +  +  VZt-p  *  UZ>  at  t3-4*1) 

2.  Higher-order  moving  average  terms  in,  say,  an  MA(q)  model 

Zt  m  ^  Z  at  —  ®  lat— 1  —  •••  —  ®qat-q  (3.4.2) 

3.  Both  autoregressive  and  moving  average  terms  in,  say,  an 

ARMA(p,q)  model 

zt  ■  W  Z  +  «>l<Zt-l  -  u  z)  +  •••  +  Vzt-p  ”  M  Z} 

+  at  —  0  •••  —  ®qat-q*  (3.4.3) 

If  the  MRP  of  Dudewicz  and  Zaino  (1977)  for  AR(1)  processes  can  be 
generalized  to  include  ARMA(p,q)  processes,  then  a  large  class  of 
discrete-event  simulations  can  then  be  tested  to  find  the  "best” 
alternative.  However,  it  is  known  that  many  of  the  covariance 
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stationary  processes  generated  by  simulation  models  in  steady-state 
operation  do  not  have  a  finite-order  representation  in  any  of  the 
forms  (3.4.1),  (3.4.2),  or  (3.4.3)  (Fishman,  1973,  p.  185).  In  this 
section  we  extend  the  Dudewicz-Dalal  multiple  ranking  procedure  to 
ARMA(p,q)  processes  and  then  to  general  covariance  stationary 
processes. 

In  the  case  of  a  stationary  AR(1)  process  with  white  noise 
variance  o“  (representation  (3.4.1)  with  p  *  1),  the  key  to  the 
Dudewicz-Zaino  procedure  is  the  observation  that  the  sample  mean 

Zn  -  n*1  I  Zt  (3.4.4) 

t-1 

has  variance 

Var(Zn)  -  n-1 1  a*/(l  -  <p  })1(1  +  *x)/ll  -  4>j)  +  0(n"2).  (3.4.5) 

In  terms  of  ■  o^/(l  -  <t>p,  we  have 

yz  -  lim  n*Var(Zn)  -  o|‘(l  +  ^/(l  -  c|> j ).  (3.4.6) 

n  — >  °° 

In  effect  Dudewicz  and  Zaino  used  the  large-sample  approximation 

Var(Zn)  S  yz/n  -  (  o2/n)*(l  +  ♦jJ/d  -  $j)  (3.4.7) 

to  derive  their  sample  size  formula  for  ranking  K  alternative  AR(1) 
processes  with  indifference  zone  width  A*  and  probability  of  correct 
selection  P*: 

N2  -  h2(P*,  K)  •  Yz/(  A*)2  (3.4.8) 

-  [h2(P*.  K)  *  a|/(  A*)2]  •  (1  +  ♦p/d  -  (3.4.9) 

The  term  (1  +  4>p/(l  -  ^ )  in  (3.4.9)  is  called  the  run  length 

"inflation  factor."  Since  the  data  are  correlated,  each  observation 


r  .  .kjK-  •MU**?'  *f  •* 


yields  less  new  Information  about  the  process  mean  than  if  the  data 
were  independent.  Therefore,  the  run  length  must  be  increased  to 
account  for  the  "loss"  of  information  caused  by  the  correlation.  As 
expected,  if  the  correlation  between  observations  increases,  then  the 
required  run  length  will  also  increase. 

Now  a  stationary  ARMA(p,q)  process  can  be  represented  in  the 

form 

00 

zt  -  I  %  a t.  (  V  -  1),  (3.4.10) 

j-0  J 

where  the  function 

00 

Y  (  D  *  Z  V*  (3.4.11) 

j-0  J 

of  the  complex  variable  |  is  analytic  in  the  open  disk  |  £|  ^1  +  6 
for  some  6  >  0.  Since  the  white  noise  process  (at)  is  uncorrelated, 

it  is  straightforward  to  show  that 

00 

Yk  -  Cov(2t,  Ze<k)  -  of  I  V  (3.4.12) 

for  k  0.  It  follows  that 
+  °° 

\  -  Z  \  "  aa  *  4'2^1)  *  (3.4.13) 

k-  -  00 

If  we  define  the  polynomials 

*  (*)  -  1  ~  ♦i  51  -  ...  -  4>pep  ,  (3.4.14) 

6  <  £>  -  1  -  0  i  £  -  •••  “  6qCq  ,  (3.4.15) 

then  4>  (  £  )  has  no  roots  in  the  disk  |  £  |  <  1  +  6  ,  and  we  have  (Box 
and  Jenkins,  1976,  p.  53) 
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¥  (  C  )  "  9  (  g )/  $  (  O  for  |g|  <  1  +  6  (3.4.16) 

Combining  (3.4.13)  and  (3.4.16),  we  finally  obtain  a  result  analogous 
to  (3.4.6) 

Yg  m  (1  ~  ®1  ”  ***  "  6q)^/(l  -  <J>  ^  —  •••  “  <f)p)  •  (3.4.17) 

Thus  the  analogue  of  the  sample-size  formula  (3.4.8)  for  a  stationary 
ARMA(p,q)  process  is 

2  *  *  -2  2  (1  -  61  -  -  6q^2 

N,  -  h2(P  ,  K)*(  A  )  2  *  at  *  - 3--  (3.4.18) 

(l  -  j  —  ...  -  )  . 

There  are  two  major  drawbacks  to  the  use  of  a  multiple  ranking 
procedure  based  on  (3.4.18).  As  previously  mentioned,  the  first  and 
most  basic  problem  is  that  some  simulation  output  processes  do  not 
have  a  finite-order  ARMA  representation.  The  second  problem  is  that 
(3.4.18)  requires  the  implementation  of  subroutines  to  perform 
automatic  ARMA  model  identification  and  parameter  estimation.  In  an 
extensive  experimental  investigation  of  the  use  of  automatic  ARMA 
modeling  algorithms  in  queueing  simulation,  Schrlber  and  Andrews 
(1982)  reported  poor  coverage  for  the  associated  confidence  interval 
estimators.  Although  (3.4.18)  sheds  new  light  on  the  central  issues 
involved  in  ranking  correlated  processes,  a  more  flexible  and  robust 
approach  is  required  for  application  to  discrete-event  simulation. 

Spectral  analysis  provides  an  alternative  means  of  extending 
the  basic  work  of  Dudewicz  and  2alno.  If  the  covariance  stationary 
process  (Zt)  has  the  spectral  density  function 
+  00 

p(f)  ■  Z  Yk  •  cos (2  trfk),  -  1/2  «  f  <  1/2,  (3.4.19) 

k-  -  oo 


1 


1 
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then  we  see  that 

Yz  -  p(0);  (3.4.20) 

and  the  generalized  analogue  of  the  sample-size  formula  (3.4.8)  is 

N2  -  h2(P*,  K)  *  p(0)/(  A*)2  .  (3.4.21) 

Thus  to  choose  among  K  covariance  stationary  processes  (Z^t  :  t  >  0), 

1  ^  j  ^  K,  with  indifference  zone  width  A*  and  probability  of  correct 

selection  P*,  the  following  multiple  ranking  procedure  is  proposed: 

Procedure  P_ 

_ s 

1.  Accumulate  an  initial  series  (Zjt  :  t  *  1,  ...,  nQ)  of  length 
nQ  >,  30. 

2.  Compute  the  Heidelberger-Welch  (1981)  estimator  Pj(0)  of  the 
spectrum  at  zero  frequency  using  the  series  (Zjt  :  t  ■  1,  ...» 

no>* 

3.  Compute 

nj  -  max  { nQ,  (h2(n0,P*,K)  .  Pj(0)/(  A*)2]  },  (3.4.22) 

where  [y]  denotes  the  smallest  integer  ^  y  and  h  *  h(nQ,P*fK) 
is  the  unique  solution  of  the  equation 


(F(z+h;  n0-l))K_l 


f (z;nD-l)dz 


(3.4.23) 


in  which  f(*;  v  )  and  F(*;  v  )  respectively  denote  the  PDF  and 
CDF  of  a  Student's  -  t  variate  with  v  degrees  of  freedom. 

4.  If  n  ■  nQ,  go  to  step  5.  Otherwise,  generate  the  next  n-nQ 
observations  (Zjt  :  t  ■  nQ  +  1,  ...»  n)  from  the  process. 

3.  Compute  the  usual  sample  mean  from  the  entire  series 
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Zj  m  n"I*  £  Zt*  (3.4.24) 

J  J  t-1  J 

and  finally  select  the  process  yielding  the  maximal  value 
2[K]* 

3.4.2  Calculation  of  Dudewicz-Dalal  Critical  Values 
Development.  It  is  awkward  to  require  the  user  of  procedure 
Pg  to  input  the  critical  value  h(nQ,  P*,  K)  corresponding  to  the 
preselected  levels  of  nQ,  P*,  and  K.  Moreover,  it  is  infeasible  to 
enter  the  large  table  of  critical  values  produced  by  Dudewicz, 
Ramberg,  and  Chen  (1975)  directly  into  the  support  procedure. 
Therefore,  it  was  necessary  to  include  within  the  MRP  program  a 
subroutine  (RNKSEL)  to  solve  equation  (3.4.23)  numerically. 

In  terms  of  the  function 

+  00 

g(h)  «  J  (F(z+h;nD-l))K~1  f(z;nQ-l)dz,  (3.4.25) 

subroutine  RNKSEL  is  designed  to  find  the  root  of  the  equation  g(h)  • 
P*.  To  do  this,  RNKSEL  first  must  determine  limits  of  integration,  a 
and  b,  such  that  the  function 

g*(h)  -  f  (F(z4h;n0-1))K_1  f(z;nQ-l)dz,  (3.4.26) 

a  'J 

satisfies 

|g(h)  -  g*(h)  |  <  10-6  for  all  h. 


(3.4.27) 
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Using  Che  IHSL  routine  MDST1  with  a  value  of  10~^  as  the  total  area 

allowed  in  both  tails  of  the  Student's  -  t  distribution  with  n  -  1 

o 

degrees  of  freedom,  RNK.SEL  obtains  a  cutoff  value  b  with  upper  tail 

area  equal  to  0.5  x  10“^.  The  lower  limit  a  is  set  equal  to  -b.  This 

ensures  that  equation  (3.4.27)  is  satisfied.  The  IMSL  routine  ZSCNT 

is  then  used  to  find  the  root  of 

g*(h)  -  P*  -  0  (3.4.28) 

Routine  ZSCNT  is  based  on  the  secant  method  for  solving  simultaneous 

equations  (Wolfe,  1959).  To  do  the  required  integration  6hown  in 

equation  (3.4.26),  a  cautious  adaptive  Romberg  extrapolation  technique 

of  numerical  integration  is  used  (De  Boor,  1971).  For  this  purpose, 

the  IMSL  routine  DCADRE  is  invoked  with  absolute  and  relative 

—  ft 

estimation  errors  both  set  to  10  .  A  listing  of  RNKSEL  is  included 

as  a  subroutine  in  Appendix  C,  and  a  flowchart  is  depicted  in  Figure 
3.10. 


Verification  and  Validation.  This  portion  of  the  overall  MRP 
analysis  procedure  encompasses  the  routines  to  calculate  the  necessary 
discrete-event  simulation  run  length  and  the  final  steady-state 
performance  statistic.  This  performance  statistic  can  then  be 
compared  to  a  similar  measure  of  performance  for  the  other  alternative 
systems  in  order  to  Belect  the  "best”  alternative. 

The  program  DND  that  was  designed  to  perform  these 

calculations  has  the  following  Inputs: 

1*  P*,  A*,  nQ,  and  K  specified  by  the  user 
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2.  A  simulation  generated  time  series  that  has  been: 

a.  Batched  to  induce  approximate  normality  using  program 
WILK 

b.  Truncated  to  eliminate  any  initialization  bias  using 
program  IBZERO 

c.  Analyzed  by  the  Heidelberger-Welch  procedure  to 
estimate  the  spectrum  of  the  batched  process  at  zero 
frequency  (using  program  WELCH;  see  section  3.4.3). 

The  foundation  on  which  this  program  rests  is  the  code  written  to 
implement  the  Dudewicz  and  Dalai  (1975)  procedure  P£  as  described  in 
section  2.1.2.  Therefore,  the  starting  point  was  to  code  this 
procedure  and  check  it  against  the  numerical  examples  provided  by 
Dudewicz,  Ramberg,  and  Chen  (1975).  This  was  completed,  and  in  each 
case  DND  produced  results  that  are  identical  to  those  reported  in  the 
literature. 

The  next  logical  test  was  to  generate  random  samples  from  a 
set  of  normal  populations  with  known  parameters  in  order  to  verify  the 
performance  of  the  ranking  procedure.  The  sample  data  sets  were 
generated  by  the  IMSL  routine  GGNML  from  populations  arranged  in  a 
variety  of  least  favorable  configurations.  Table  3.3  displays  the 
results  of  3  separate  experiments  within  each  of  which  the  LFC  was 
fixed  and  the  exact  Dudewicz -Dalai  procedure  P£  was  replicated  100 
times.  Note  that  Table  3.3  reveals  no  significant  departures  from  the 
nominal  probability  of  correct  selection  P*  specified  for  each 
experiment. 
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Up  to  this  point,  the  critical  value  h(nD,  P  ,  K)  was  treated 
as  a  required  input  variable  for  the  program  DND.  To  eliminate  this 
input  requirement,  the  subroutine  RNKSEL  (described  in  section  3. A. 2) 
was  coded  and  integrated  with  DND.  The  resulting  program,  AUTOH,  was 
exercised  through  a  wide  range  of  possible  values  of  the  input 
parameters  nQ,  P*,  and  K;  the  resulting  critical  values  were  then 
verified  item-by-item  against  the  tables  computed  by  Dudewicz, 
Ramberg,  and  Chen  (1975). 

Further  testing  of  AUTOH  against  DND  involved  the  use  of 
common  random  numbers  to  re-create  the  experiments  described  in  Table 
3.3.  Using  the  same  random  number  seeds  for  corresponding  runs  of  DND 
and  AUTOH  ensured  that  exactly  the  same  sets  of  data  were  generated 
for  the  comparison.  AUTOH  successfully  reproduced  the  results  shown 
in  Table  3.3.  The  detailed  output  produced  by  AUTOH  for  the  second 
experiment  is  shown  in  Figure  3.9.  A  listing  of  AUTOH  is  shown  in 
Appendix  C.  The  AUTOH  flowchart  is  Figure  3.10. 

Up  to  this  point,  all  of  the  testing  had  been  limited  to 
independent  normal  samples.  The  next  logical  step  was  the 
implementation  of  procedure  P8  to  handle  correlated  data.  The  main 
prerequisite  for  this  step  of  the  research  was  the  development  of  a 
support  routine  to  estimate  the  spectrum  at  zero  frequencv. 

3.4.3  Spectral  Analysis  Procedure 

Development.  To  determine  the  spectral  density  at  zero 
frequency,  the  first  step  is  to  calculate  the  fast  Fourier  transform 
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ALTERNATIVE 
THE  TRUE  MEAN 


ALTERNATIVE 
THE  TRUE  MEAN 


ALTERNATIVE 
THE  TRUE  MEAN 


ALTERNATIVE 
THE  TRUE  MEAN 


ALTERNATIVE 
THE  TRUE  MEAN 


ALTERNATIVE 
THE  TRUE  MEAN 


FOR  THIS  TEST: 
NAUGHT  = 


1  HAS  0  BEST  RESULTS 

IS  53.00  WITH  A  STANDARD  DEVIATION  OF  4.50 

2  HAS  83  BEST  RESULTS 

IS  60.00  WITH  A  STANDARD  DEVIATION  OF  4.00 

3  HAS  5  BEST  RESULTS 

IS  53.00  WITH  A  STANDARD  DEVIATION  OF  5.50 

4  HAS  5  BEST  RESULTS 

IS  53.00  WITH  A  STANDARD  DEVIATION  OF  2.80 

5  HAS  1  BEST  RESULTS 

IS  53.00  WITH  A  STANDARD  DEVIATION  OF  6.80 

6  HAS  6  BEST  RESULTS 

IS  53.00  WITH  A  STANDARD  DEVIATION  OF  10.30 

PCS  =.800  DSEED  =  . 9841 3370D+07  DELTA  = 

7  DNDH  =2.566  NMAX  =  24 


.00 


Figure  3.9  Detailed  output  of  program  AUTOH  for  one  experiment 
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Figure  3.10  Detailed  output  of  subroutine  AUTOH  for  one  experiment 
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Figure  3.10  (continued) 
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of  the  observed  series  (Zt  :  t  ■  1,  n) 

n 

dy  -  I  Zt  *  exp  [-  12  Ti(t-l)(u-l)/n],  u  -  1,  ...»  n,  (3.4.29) 

t*l 

where  i  *  (-1)*^.  The  periodogram  defined  by  equation  (2.4.7)  is 
then  given  by 

I(s/n)  -  |  dg+1  |  2/n,  s  -  0,  1,  ...,  n-1.  (3.4.30) 

The  spectral  analysis  procedure  WELCH  actually  invokes  the  IMSL 
routine  FFTRC  to  compute  the  complex  conjugate  (3u:  u  ■  1,  ...»  n)  of 
the  fast  Fourier  transform.  Since  the  absolute  value  of  a  complex 
number  is  Invariant  under  conjugation,  this  complication  does  not 
affect  the  computation  (3.4.30)  of  the  periodogram. 

To  stabilize  the  variance  so  that  a  polynomial  can  be  fitted 
by  the  method  of  ordinary  least  squares,  the  periodogram  is  averaged 
over  adjacent  values  and  a  logarithmic  transformation  is  applied;  then 
the  constant  0.270  is  added  to  eliminate  the  bias  Induced  by  the 
logarithmic  transformation: 

Yu  -  0.27  +  ln(  [I((2u-1 )/n)  +  I(2u/n)]/2  ), 

u  •  1,  ...»  n/4  .  (3.4.31) 

Corresponding  to  the  uth  observation  Yu  of  the  dependent 
variable,  there  can  be  up  to  d  ■  5  Independent  variables  of  the  form 

Xuk  "  I(4u-l)/(2n)]k  ,  k  -  1,  ...,  d  .  (3.4.32) 

Program  WELCH  uses  a  forward  stepwise  algorithm,  IMSL  routine  RLSEP, 
to  find  the  best  regression  model  of  the  form 
d 

Y  ■  Z  ®kXuk  ^  ^u’  u  -  1,  ...,  n/4. 

k-0 


(3.4.33) 
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Parameters  are  set  in  RLSEP  so  that  the  significance  level  for 
entering  and  leaving  variables  is  0.05,  and  a  partial  F-test  is 
performed  for  each  term  in  the  model.  From  the  final  regression  model 
(3.4.33)  selected  by  RLSEP,  the  estimated  intercept  £q  must  be  taken 
together  with  the  final  design  matrix  X  ■  || X^k  |  j  to  estimate  the 

spectral  density  at  zero  frequency: 

p(0)  -  exp(  aQ  -  0. 3225((X'X)-1]11)  (3.4.34) 

Unfortunately  RLSEP  does  not  produce  the  upper  left  most  element  of 
(X*X)_1  as  an  ancillary  output.  To  obtain  this  element,  the  final 
independent  variables  chosen  by  RLSEP  are  used  as  inputs  to  another 
IMSL  regression  analysis  routine,  RLMUL,  after  the  required 
conditioning  has  been  performed  by  routine  BECOVM.  RLMUL  performs  the 
computations  required  for  a  standard  multiple  linear  regression 
analysis  and  supplies  as  outputs  the  values  for  the  residual  mean 
square,  MSg,  and  the  estimated  standard  error  of  the  Intercept, 
SE(8q).  The  required  element  is  given  by 

(X’X)-1  -  [SE(a0)]2/MSE  .  (3.4.35) 

The  overall  flowchart  of  program  WELCH  is  shown  in  Figure  3.11.  The 
program  listing  is  presented  in  Appendix  D. 

Verification  and  Validation.  During  the  development  of 
program  WELCH,  several  intermediate  tests  were  performed. 
Specifically,  the  integration  of  the  IMSL  regression  routines  RLSEP 
and  RLMUL  was  tested  on  the  well-known  Hald  data  (Draper  and  Smith, 
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|  Initialize  variables  U,  SD  f 

U 

DO  J:  -  1,25 

// 

// 

DO  K:  ■  1,  NDATA 

// 

// 

(ggnml(r)} 

// 

// 

// 

DATA(K) :  -  R(J)  *  SD  +  U 

NHDATA:  -  NDATA/2 

// 

// 

NQDATA:  -  NQDATA/2 

II 

FFTRC(DATA,  TRANS) 

COMPUTE  PERIODOGRAM 

1/ 

n 

n 

a 

n 

PERIOD  (L) 

SMOTH:  -  ((PERIOD (L)  +  PERIOD  (L+l))/2) 

FJ (L) :  -  ALOG(SMOTH)  +  .270 

C  RLSEP(FJ)^ 

CJE£OV>Q 

n 

(  rlmulcfjA 

n 

DETERMINE  UPPER  LEFT  ELEMENT  (UPLEFT) 

n 

IN  REGRESSION  MATRIX 

n 

CONE:  -  EXP(-  0.3225  *  UPLEFT) 

// 

COMPUTE  SPECTRAL  DENSITY  AT  ZERO  FREQUENCY 

i/ 

COMPUTE  CLASSICAL  VARIANCE  ESTIMATE 

PRINT  RESULTS 

Figure  3.11  Flowchart  of  WELCH  for  estimation 
of  the  spectrum  at  zero  frequency 


Figure  3.11  (continued) 


1967,  p.  164).  The  final  model  obtained  by  WELCH  coincides  with  the 
results  found  by  Draper  and  Smith  (1967,  Appendix  B). 

The  first  overall  test  of  the  spectral-estimation  logic  used 
independent  identically  distributed  normal  variates.  In  each  of  5 
different  experiments,  a  normal  population  was  specified  and  the  1MSL 
routine  GGNML  was  used  to  generate  25  random  samples  of  size  100  from 
that  population.  For  each  sample,  both  the  sample  variance  and  the 
estimated  spectrum  at  zero  frequency  were  calculated.  These  estimates 
were  then  averaged  over  each  experiment.  The  results  are  shown  in 
Table  3.4. 


Table  3.4  Performance  of  spectral-estimation  routine 
WELCH  for  independent  normal  samples. 


POPULATION 

y 

PARAMETERS 

a2 

SAMPLE 

S2 

ESTIMATES 

P(0) 

50 

25 

25.1 

25.6 

22 

25 

25.5 

26.6 

50 

900 

917.1 

956.3 

10 

36 

36.4 

37.9 

5 

36 

38.0 

40.0 

Following  this  comparison,  program  WELCH  was  tested  on 
correlated  data.  All  test  series  were  generated  by  the  previously 
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discussed  program  ARMAPQ  using  autoregressive  and  moving-average 
parameters  that  were  selected  to  ensure  stationarity  and  invertibility 
(Box  and  Jenkins,  1970,  Charts  B,  C,  and  D).  The  theoritical  value  of 
the  spectrum  at  zero  frequencv  was  calculated  using  equation  (3.4.17). 
Table  3.5  shows  the  parameters  used  to  generate  each  ARMA  process,  the 
theoretical  value  p(0),  the  estimate  p(0)  produced  by  WELCH,  and  the 
sample  size  n. 


3.4.4  Integrated  Testing  of  Multiple  Ranking  Procedure 
Up  to  this  point  we  have  demonstrated  separately  the 
successful  implementation  of  the  exact  Dudewicz-Dalal  procedure  P£ 
(program  DND),  the  automatic  determination  of  the  critical  value  h(nQ 
P*,  K)  (program  AUTOH),  and  the  estimation  of  the  spectrum  at  zero 
frequency  p(0)  (program  WELCH).  To  develop  a  program  to  perform  the 
extended  oultiple  ranking  procedure  Pg  requires 

1.  The  integration  of  AUTOH  and  WELCH 

2.  The  elimination  of  the  weighting  scheme  (2.1.16)  within  AUTOH. 
The  final  integrated  package  was  called  NOWAIT. 

As  with  the  previously  discussed  programs,  the  first  overall 
test  of  NOWAIT  used  independent  normally  distributed  data  sets 
representing  K  alternatives  with  the  means  arranged  in  a  least 
favorable  configuration.  The  parameters  of  the  selected  normal 
populations  are  shown  in  Table  3.6.  The  NOWAIT  procedure  was 
replicated  100  times  using  this  configuration  of  normal  populations. 
The  overall  results  for  this  experiment  are  shown  in  Figure  3. 12.  The 
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ALTERNATIVE  1  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  8.50 


ALTERNATIVE  2  HAS  96  BEST  RESULTS 

THE  TRUE  MEAN  IS  60.00  WITH  A  STANDARD  DEVIATION  OF  8.00 


ALTERNATIVE  3  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  10.10 


ALTERNATIVE  l*  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  5.60 


ALTERNATIVE  5  HAS  1  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  12.80 


ALTERNATIVE  6  HAS  3  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  20.30 


FOR  THIS  TEST:  PCS  =.950  DSEED  =  .175000000+03  DELTA  =  7. 

NAUGHT  =  30  DNDH  =3.297  NMAX  =  93 


Figure  3*12  Output  for  Independent  normal  test 


of  the  Integrated  package  NOWAIT 


89 


variable  NMAX  shown  In  Figure  3. 12  is  the  largest  sample  size  needed 
on  any  replication  of  the  procedure*  The  critical  value  h(nQ  ■  30,  P* 
■  0.95,  K  ■  6)  is  shown  to  be  approximated  3.297  for  this  particular 
test. 

An  additional  test  using  Independent  normal  samples  was 
performed  with  1  of  9  population  means  lying  within  the  indifference 
zone.  The  results  shown  in  Figure  3.13  reveal  that  while  the  program 
did  not  pick  the  "best"  alternative  on  90%  of  the  replications,  it  did 
pick  a  population  lying  within  the  indifference  zone  on  99%  of  the 
replications. 

The  final  check  of  program  NOWAIT  used  covariance  stationary 
series  generated  by  the  subroutine  ARMAPQ  as  previously  discussed. 
The  mean  values  of  these  ASMA  processes  were  established  to  produce  a 
series  of  alternatives  arranged  in  a  least  favorable  configuration. 
The  test  series  included  AR(1),  AR(2),  MA(1),  MA(2),  and  ARMA(1,1) 
models.  The  result  of  this  testing  is  shown  in  Table  3.7.  Included 
in  the  table  are  the  parameters  used  for  the  ranking  procedure  and  the 
maximum  sample  size  required.  The  percentage  of  correct  selections  is 
based  on  fifty  Independent  replications  of  a  particular  configuration 
of  ARMA  processes.  Table  3.8  Bhows  the  autoregressive  and  moving 
average  parameters  used  to  generate  each  of  the  test  series.  These 
results  provide  good  evidence  of  the  utility  of  the  multiple  ranking 
procedure  Pg  for  covariance  stationary  processes. 
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ALTERNATIVE  1  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  8.50 


ALTERNATIVE  2  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  8.00 


ALTERNATIVE  3  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  10.10 


ALTERNATIVE  4  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  5.60 


ALTERNATIVE  5  HAS  1  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  12.80 


ALTERNATIVE  6  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  20.30 


ALTERNATIVE  7  HAS  0  BEST  RESULTS 

THE  TRUE  MEAN  IS  53.00  WITH  A  STANDARD  DEVIATION  OF  3.40 


ALTERNATIVE  8  HAS  16  BEST  RESULTS 

THE  TRUE  MEAN  IS  58.00  WITH  A  STANDARD  DEVIATION  OF  9.50 


ALTERNATIVE  9  HAS  83  BEST  RESULTS 

THE  TRUE  MEAN  IS  60.00  WITH  A  STANDARD  DEVIATION  OF  8.60 


FOR  THIS  TEST:  PCS  =.900  DSEED  =  . 56732100D+06  DELTA  =7.00 

NAUGHT  =  30  DNDH  =3.051  NMAX  =  159 


Figure  3.13  Output  for  Independent  normal  test  of  NOWAIT 


with  one  mean  in  the  indifference  rone. 
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Table  3.8  Configuration  of  ARMA  processes  for  testing 
the  integrated  package  NOWAIT. 


ALTERNATIVE 

MODEL 

♦i 

4>2 

61 

02 

0  a 

P(0) 

1 

AR(1 ) 

0.6 

400 

2500 

2 

AR(2J 

-0.35 

0.25 

625 

516 

3 

MA(1) 

-0.4 

400 

784 

4 

MA(2) 

0.75 

-0.5 

1225 

689 

5 

ARMA(1,1) 

-0.5 

0.15 

1600 

514 

6 

ARMA(1,1) 

0.6 

0.2 

169 

676 

7 

ARMA(1,1) 

0.75 

-0.5 

49 

1764 

CHAPTER  IV 


EXPERIMENTAL  RESULTS 


Although  the  autoregressive-moving  average  processes  described 
in  Chapter  III  provide  an  appropriate  means  for  verification  and 
validation  of  procedure  NOWAIT,  such  processes  cannot  adequately 
represent  the  full  variety  of  transient  and  stationary  time-series 
behavior  characteristic  of  discrete-event  simulations.  This  chapter 
presents  the  results  of  two  meta-experimentB  that  were  specifically 
designed  to  evaluate  the  robustness  of  the  miltiple  ranking  procedure 
when  it  is  applied  to  diverse  simulation  models.  In  the  first 
meta-experiment,  the  procedure  was  applied  to  the  customer  sojourn 
time  process  in  several  tandem  queueing  systems  with  both  high  and  low 
traffic  intensities.  The  second  meta-experiment  focused  on  the  series 
of  yearly  costs  incurred  during  the  operation  of  several  (s,S) 
inventory  systems. 

4. 1  Comparison  of  Tandem  Queueing  Systems 

The  first  meta-experiment  involves  the  comparison  of  three 
alternative  configurations  for  a  proposed  repair  facility.  The  layout 
for  each  alternative  is  shown  in  Figure  4.1.  The  calling  units  to  be 
repaired  arrive  according  to  a  Poisson  process  with  rate  *  .  In 
system  A1  (i  *  1,  2,  3),  there  are  i  M/M/1  workstations  in  tandem;  and 
service  times  at  each  workstation  are  IID  exponential  with  mean  U 
■  (i  P  )”*.  The  traffic  intensity  P  ■  ^  ’(ip^1)  ■  X/u  <  1  ensures 
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Exponential  service,  rate  y  1 

S1  “ 

FIFO 

Poisson  arrivals,  rate  *  X  - > 


U 

server 

> 


Alternative  Aji  M/M/1  queue. 


ui  ■  2u  y  2  "  2u 

s^  ■  1  82  ■  1 


FIFO  FIFO 


Alternative  A2:  Two  M/M/1  queues  in  tandem. 


U  x  -  3y  U  2  -  3  y  3  -  3U 

8^  *  1  S2  M  1  S3  *  1 

FIFO  FIFO  FIFO 

*  ->  m©  ->  m©  ->  m©  -> 

Alternative  A3:  Three  M/M/1  queues  in  tandem. 


Figure  4.1  Layout  of  tandem  queueing  systems 
compared  in  the  first  meta-experiment. 
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Chat  system  is  stable  and  thuB  has  a  limiting  (steady-state) 
distribution  for  the  time-in-system  process  (that  is,  for  the  sojourn 
times  observed  bv  successive  customers).  It  is  desired  to  select  the 
configuration  whose  mean  sojourn  time  is  smallest.  The  alternative 
systems  are  to  be  tested  at  the  traffic  intensities  p  ■  0. 5  and  p  * 
0.8. 

Event-oriented  models  of  these  systems  were  implemented  in  the 
SLAM  simulation  language  (Pritsker  and  Pedgen,  1979).  Complete 
program  listings  are  given  in  Appendix  E.  Although  it  is 
substantially  easier  to  build  a  process  interaction  model  of  each 
alternative,  it  should  be  noted  that  the  comparable  event-oriented 
model  requires  significantly  less  execution  time.  Because  of  the 
scale  of  the  experimentation  performed  in  this  research,  execution 
efficiency  was  a  critical  factor  in  the  choice  of  modeling  technique. 

Since  there  is  no  restriction  on  queue  capacity  at  the  repair 
stations,  each  station  can  be  analyzed  separatelv  as  a  single-stage 
(nonseries)  queueing  model  (Gross  and  Harris,  1974,  p.  198). 
Additionally,  with  the  first  station  being  a  M/M/1  queue,  the  steady 
state  departure  process  has  the  same  distribution  as  the  interarrival 
time  process.  Therefore,  all  repair  stations  can  be  treated  as  M/M/1 
queues;  and  the  average  time  in  system  for  the  multistage  queue  is  the 
appropriate  multiple  of  the  mean  sojourn  time  in  one  M/M/1  queue: 

Wi  -  i*(Ui  -  X)-1  -  i/(y  -  X  /i).  (4.1.1) 
If  we  take  y  ■  1  so  that  X  ■  1/  p,  then  the  mean  sojourn  times  (W^: 
i  -  1,  2,  3)  for  the  various  alternatives  are  given  in  Table  4.1. 
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Table  A.l  Mean  Sojourn  times  for  tandem  queueing  systems. 


System 

Traffic 

Intensity 

Ai 

0.5 

0.8 

A1 

2.00 

5.00 

A2 

1.33 

1.67 

A3 

1.20 

1.36 

This  analysis  shows  that  configuration  A^,  three  fast  servers, 
has  the  smallest  average  time  in  system  and  is  therefore  judged 
"best".  The  results  in  Table  A.l  were  also  used  to  determine  the 

indifference  zone  for  the  multiple  ranking  procedure.  The  value  of 
A*  was  set  so  that  the  difference  between  the  smallest  mean  sojourn 
time  and  the  next  smallest  is  greater  than  A*: 

W[2]  _  w[l]  >  *  (A. 1.2) 

Thus  when  p  •  0.5,  we  took  A*  *  0.1;  and  when  p  *0.8,  we  took  a* 
•  0.3.  For  completeness,  the  first  meta-experiment  also  included  two 
levels  for  the  probability  of  correct  selection:  P*  ■  0.90  and  P*  * 
0.95. 

Figure  A. 2  is  a  flowchart  of  the  protocol  that  was  followed  in 
the  first  meta-experiment.  The  steps  of  this  protocol  are  enumerated 
below: 

1.  The  alternative  to  be  simulated  is  initialized  in  the  "empty 
and  idle"  state.  As  each  customer  departs  the  last  station, 


DATA(I,J)  «  XX(1) 


I.J ;  -  16,  10 


(SWSUB(DATA,  NSIZE)) 


// 

// 

// 


DO  I: 


1,100 


DNORMAL ( I )  -  DATA(16,I) 


C"lBSUB (DNORMAL.  NSIZE.  I FAULT,  BATCH,  NUMBAT)  ) 


£ 


IFAULT:  -  50 


z 


Need  more  data,  haven’t  reached 
steady  state.  Go  to  simulation 


C*IBSUB (DNORMAL,  NSIZE,  IFAULT,  BATCH,  NUMBAT 3) 


CMRPSUB (NUMBAT.  BATCH,  NE 


Indication  of  needing  more  data 
NEXTRA  >  NUMBAT 


Get  more  data  from  simulation 
(NEXTRA  -  NUMBAT) 


NEXTRA:* 

NUMBAT 


Calculate  final  performance  measure 

//  DO  I:  -  1,  NEXTRA 

J! 

// 


FIN ALT:  *  FINALT  +  BATCH  (I) 


COMPARE:  -  FINALT/NEXTRA 


PRINT  COMPARE 


Set  indicator  to  stop  simulation 
MSTOP:  -  -1 


RETURN 


(J5VENT(1)  j 


Figure  4.2  (continued) 
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C  SWSUB  J 


Calculates  required  batch 
size  to  achieve  normality 
In  DATA(16,100)  using 
Shapiro-Wllk  test. 


IBSUB 


3 


Detects  initialization  bias 
and  truncates  detected 
transient  using  CUSUM  test. 
Variance  estimated  by  a 
jS£ectral_method^^^^^^^^^ 


^  MRPSUB 

Calculates  required  simulation  run  length  to  meet 
user  set  parameters  using  Dudewicz-Dalal  procedure 
extend  to  any  covariance  stationary  process. 
Variance  estimated  by  a  spectral  method. 


Figure  4.2  (continued) 
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his  system  residence  time  (waiting  time  plus  service  time)  is 
recorded.  The  run  is  terminated  after  100  sojourn  times  have 
been  recorded. 

2.  The  random  number  streams  are  independently  reseeded  and 
another  run  is  executed.  The  simulation  stops  upon  completion 
of  16  independent  replications  of  100  customers  each. 

3.  Subroutine  NQUE  is  called.  To  determine  an  adequate  batch 

size  (NSIZE),  subroutine  SUSUB  is  called  by  NQUE. 

4.  The  data  recorded  during  the  last  replication  is  grouped  into 
b  -  100/NSIZE  batches  and  is  then  tested  for  the  presence  of 
initialization  bias  by  subroutine  IBSUB.  Appropriate  data 
truncation  is  performed  and  the  remaining  set  of  nQ  batch 
means  is  ready  for  further  processing. 

5.  Subroutine  MRPSUB  is  invoked.  MRPSUB  first  calls  subroutine 
RNKSEL  to  compute  the  Dudewicz-Dalal  critical  value  h(nQ,  P*, 
K).  MRPSUB  then  calls  subroutine  WELCH  to  obtain  the 
estimated  spectrum  at  zero  frequency  p(0).  Finally,  the 
required  simulation  run  length  n  is  computed  from  equation 
3.4.22  . 

6.  The  16th  replicate,  which  was  suspended  to  perform  steps  3 
through  5  above,  is  now  resumed.  This  run  is  terminated  when 
(n  -  nQ)*NSIZE  additional  customers  have  been  simulated. 


7.  The  final  estimator  of  W^  is  the  unweighted  sample  mean 


101 


of  all  the  observations  generated  on  the  last  replication  of 
alternative  (excluding  the  truncated  observations)* 

8.  Steps  1  through  7  are  repeated  50  times,  and  each  final 
performance  statistic  is  stored.  Each  of  the  50  experiments 
is  started  with  a  randomly  selected  random  number  seed.  This 
ensures  that  the  50  experiments  performed  on  each  alternative 
are  independent. 

9.  For  each  alternative  under  consideration,  steps  1  through  8 
are  repeated. 

10.  The  final  results  for  each  alternative  are  compared 

experimentwise  —  that  is,  for  each  experiment,  the 

alternatives  Aj,  A£,  and  Aj  are  compared  and  the  "best" 
alternative  is  selected.  The  final  selections  are  tallied 

over  all  50  experiments. 

Table  4.2  summarizes  the  results  of  the  first  meta-experiment. 

Table  4.2  Final  results  of  the  first  meta-experiment. 


1 

Random  Number 

Stream  Used 

H 

H 

H 

#  Times  Selected 

Ai  A2  A3 

2  Correct 

Selections 

1 

4 

0.5 

0.1 

0.95 

D 

1 

49 

982 

2 

6 

0.5 

0.1 

0. 95 

0 

1 

49 

982 

3 

3 

0.8 

0.3 

0,90 

0 

1 

49 

982 

4 

6 

0.8 

0.3 

0.90 

0 

5 

45 

902 
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The  test  results  demonstrate  that  the  integrated  MRP  does 
determine  adequate  simulation  run-lengths.  The  resultant  steady-state 
performance  estimators  of  the  form  (4.1.3)  appear  to  satisfy  the 
nominal  probability  requirement;  in  every  case  the  actual  percentage 

of  correct  selections  does  not  differ  significantly  from  the  nominal 

* 

percentage  P  . 

4.2  Comparison  of  (s,S)  Inventory  Systems 

To  examine  the  performance  of  the  multiple  ranking  procedure 
under  conditions  radically  different  from  those  observed  in  queueing 
systems,  we  applied  the  procedure  to  K  ■  6  (s,S)  inventory  systems 
with  probability  requirement  P*  »  0.85.  For  this  situation,  "best" 
refers  to  the  system  with  the  lowest  expected  annual  operating  cost. 
The  following  costs  are  associated  with  each  inventory  system: 

Ordering  cost  0C  -  $0. 50/order  (4.2.1) 

Holding  cost  HC  ■  $0. 10/unit -week  (4.2.2) 

Shortage  (backorder)  cost  SC  ■  $1. 00/unit.  (4.2.3) 

The  (s,S)  ordering  policy  operates  as  follows:  if  the  number 
of  units  on  hand  at  the  end  of  the  week  is  less  than  the  reorder  point 
s,  an  order  is  placed  to  bring  the  inventory  position  up  to  the  stock 
control  level  S.  (The  inventory  position  is  equal  to  the  amount  on 
hand  plus  the  amount  on  order  minus  the  amount  backordered. )  The 
order  ia  filled  immediately;  thus  when  the  store  opens  on  Monday,  the 
order  placed  on  the  preceding  Friday  has  already  arrived.  Backorders 
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are  permitted.  The  weekly  demand  is  uniformly  distributed  on  the 
range  from  0  to  6  units.  The  fixed  order  charge  OC  is  incurred  no 
matter  how  many  units  are  actually  ordered.  The  shortage  cost  SC  is 
charged  for  each  unit  backordered  in  the  week  that  the  backorder  is 
placed.  Each  unit  that  must  be  carried  over  to  the  next  week  incurs 
the  cost  HC  on  Friday.  Table  A. 3  summarizes  the  six  alternative  (s,S) 
policies  to  be  compared. 

Table  4.3  Alternative  (s,S)  inventory  systems 
compared  in  the  second  meta-experiment. 


Alternative  A^ 

Policy  (s^S^ 

A1 

(2,6) 

A2 

(3,5) 

A3 

(3,6) 

A4 

(4,6) 

A5 

(5,6) 

A6 

(6,6) 

A  generalized,  event-oriented  simulation  model  for  (s,S) 
inventory  systems  was  coded  in  the  SLAM  simulation  language.  The 
portion  of  the  program  listing  which  differs  from  that  of  the  queueing 
model  is  shown  in  Appendix  F.  The  same  protocol  was  used  for  the 
meta-experiment  involving  the  inventory  systems  as  was  used  for  the 
tandem  queueing  systems. 

The  assumption  which  makes  this  problem  analytically  tractable 
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is  that  the  starting-stock  process  (the  inventory  on  hand  at  the 
beginning  of  the  week  after  the  previous  order  has  been  received) 
exhibits  the  Markovian  property.  This  is  equivalent  to  stating  that 
the  conditional  probability  of  any  future  starting  stock  given  a 
demand  history  and  the  present  starting  stock,  is  independent  of  the 
past  demands  and  depends  upon  only  the  present  starting  stock.  Thus 
the  starting-stock  process  (Xt:  t  *  0,  1,  ...)  is  a  finite-state 
Markov  chain.  If  the  weekly  demand  has  probability  density  g^,  q  ■  0, 
1,  ..I,  then  the  chain  (Xt)  has  the  following  transition  probability 
matrix: 


s  s+1  S-l  S 


s 

80 

0  •  •  • 

0 

2  8q 

q>0  4 

s+1 

• 

• 

«1 

So  •  •  . 

0 

Z  8q 
q>l  q 

• 

S-l 

8s— s— 1 

8S-s-2  *  *  • 

«0 

E 

q>S-s-l 

s 

«S-s 

gS-8-l  *  •  • 

«1 

80  +  Z 
q>S 

In  particular,  the  (4,6)  policy  (alternative  A^)  has  the 
one-step  transition  matrix: 


(4.2.4) 


following 


4 

5 

6 

4 

.1429 

0 

.8571 

P(A 4)  -  5 

.1429 

.1429 

.7142 

6 

.1429 

.1429 

.7142 

f rfbaTi 


The  vector  of  steadv-state  probabilities 


JIT,  “  l  TTsi  . .  7T  S  ^ 

is  found  by  solving  the  following  system  of  equations: 


(4.2.6) 


(4.2.7) 


TT  ■  IT  P  ~) 

~  ~~  l  . 

JL  *  i  -  i  J 

For  example,  in  the  (4,6)  inventory  system  (alternative  A^),  the 
steady-state  distribution  of  the  starting  stock  is:  tt^  *  0.1429, 

-  0.1224,  tt6  -  0.7347. 

The  expected  value  of  the  weekly  cost  process  (Ct:  t  ■  1,  2, 
...)  can  be  computed  by  a  straightforward  application  of  the  law  of 
total  probability: 


E(Ct)  -  I  TT  •  'Z[Ct  (  Xt  -  J] 
j-s 


OC 


+  HC 


S  /  °°  \ 

*  1  "j  *  Z  *q 

j“8  \q“j-s+l  M/ 

*  z  *[  z  (j-q)gql 

i-s  J  <-q-0  qj 


+  SC  . 


I  TTj  •[  E  (q-j)g  ] 
j“S  Lq-j 


(4.2.8) 


Table  4.4  summarizes  the  expected  yearly  operating  costs  for  each  of 
the  alternative  inventory  policies. 
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Table  4.4  Expected  yearly  operating  costs  for 
(s,S)  inventory  systems. 


Inventory  Policy 

Expected  Yearly  Costs 

(2,6) 

$  42.17 

(3,5) 

40.66 

(3,6) 

36.95 

(4,6) 

34.35 

(5,6) 

35.13 

(6,6) 

37.89 

As  in  the  case  of  the  repair  facility  simulation,  each 
alternative  inventory  policy  was  subjected  to  50  independent 
multiple-ranking  experiments.  Each  experiment  consisted  of  16 
independent  replications  of  100  years  of  simulated  operation;  the 
final  replication  was  then  continued  to  yield  the  sample  size  required 
bv  the  multiple  ranking  procedure.  The  overall  results  of  the  second 
meta-experiment  are  summarized  in  Table  4.5. 

Table  4.5  Final  results  of  the  second  meta-experiment. 


Random  Number 

n 

H 

Number  of  Times  Selected 

Stream  Used 

no 

H 

D 

(2,6)  (3,5)  (3,6)  (4,6)  (5,6)  (6,6) 

7 

100 

0.75 

0.85 

0  0  0  50  0  0 

7 

30 

0.75 

0.85 

0  0  0  48  2  0 

107 


The  cost  process  (Ct)  in  an  (s,S)  inventory  system  exhibits  a 
correlation  structure  which  is  fundamentally  different  from  that  of 
the  sojourn  time  process  in  an  M/M/1  queue.  This  is  shown  graphically 
in  Figures  4.3  and  4.4.  Thus  whereas  the  sample  variance  of  n 
successive  M/M/1  sojourn  times  seriously  underestimates  the  variance 
parameter 

Yw  -  n*  lim  Var(Wn)  -  p^O) 
n - >  00 

the  sample  variance  of  n  successive  weekly  inventory  costs 
overestimates  the  quantity 

Yc  -  n*  lim  Var(Cn)  -  pc(0)  . 

n - >  oo 

The  implication  is  that  reduced  sample  sizes  can  be  achieved  with  a 
multiple  ranking  procedure  for  inventory  cost  processes  based  on  a 
reliable  estimator  pc(0)  of  the  corresponding  spectrum  at  zero 
frequency.  To  show  this,  the  same  set  of  inventory  simulation 
experiments  was  rerun  with  the  initial  sample  size  nQ  reduced  from  100 
to  30.  The  results  are  included  in  Table  4.5. 

In  all  simulations  of  the  (s,S)  inventory  system,  the  model 
was  initialized  with  S  units  in  the  inventory.  Initialization  bias 
was  detected  in  onlv  one  of  the  100  experiments  that  were  performed. 
This  is  another  manifestation  of  the  diversity  stochastic  behavior 
achieved  by  the  use  of  both  queueing  and  inventory  models. 


CHAPTER  V 


SUMMARY  AND  RECOMMENDATIONS 

5.1  Main  Findings  of  the  Research 

If  the  practitioner  uses  the  procedures  and  programs  developed 
in  this  research  to  control  the  run-length  of  a  discrete-event 
simulation,  he  will  be  able  to  select  the  "best"  of  K  competing 
alternative  configurations  efficiently  and  reliably.  The  user  is  able 
to  set  the  probability  of  correct  selection  and  the  indifference  zone 
width  to  meet  his  needs.  The  only  assumption  required  is  that  the 
output  of  the  model  should  approach  a  covariance  stationary  process  as 
the  run  length  Increases. 

The  Shapiro-Wilk  test  has  proved  to  be  an  effective  means  for 
determining  a  batch  size  sufficient  to  induce  an  acceptable  degree  of 
convergence  to  normality  in  simulation-generated  output  series.  The 
cusum  process  defined  on  the  resulting  sequence  of  batch  means  can 
then  be  used  both  to  detect  the  presence  of  initialization  bias  and  to 
eliminate  the  bias  economically.  The  initialization  bias  test 
procedure  developed  in  this  research  has  demonstrated  its  power 
against  a  wide  range  of  alternatives,  yet  the  procedure  is  not 
dependent  on  the  particular  form  of  the  bias  function.  There  is  no 
empirical  evidence  that  the  cusum  procedure  causes  either  false 
indications  of  initial  bias  or  excessive  data  truncation. 

The  main  objective  of  this  research  was  to  develop  a 
generalized  multiple  ranking  procedure  for  covariance  stationary 
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processes.  The  Dudewicz-Zaino  procedure  for  AR(1)  processes  was  shown 
to  be  a  special  case  of  the  procedure  developed  in  this  research. 
Equally  important  to  the  potential  user  is  the  fact  that  this 
generalized  procedure  is  based  on  a  well-established  estimator  of  the 
spectral  density  at  zero  frequency.  This  spectral  method  provides  a 
simple  and  robust  means  of  capturing  the  relevant  information  about 
the  covariance  structure  of  simulation-generated  output  processes. 

The  successful  application  of  the  integrated  multiple  ranking 
procedure  to  systems  whose  outputs  exhibit  widely  differing  types  of 
stochastic  behavior  demonstrates  the  utility  of  the  procedure  in  the 
analysis  of  discrete-event  simulation  models. 

5.2  Recommendations  for  Future  Research 

The  results  of  this  research  indicate  the  need  for  further 
work  in  a  number  of  areas.  The  requirement  that  the  output  process  be 
approximately  Gaussian  warrants  additional  investigation.  Using  a 
maximum  batch  size  of  3  in  the  Shapiro-Wilk  test  does  not  seem  to 
cause  any  serious  problems  in  subsequent  stages  of  the  multiple 
ranking  procedure.  This  casts  some  doubt  on  the  necessity  for 
normally  distributed  observations.  Clearly,  we  require  a  more  precise 
understanding  of  the  role  of  batching  in  guaranteeing  the  reliability 
of  the  nultiple  ranking  procedure. 

While  the  initialization  bias  test  procedure  proved  to  be 
effective  for  a  broad  range  of  transient  processes,  one  deficiency  is 
still  evident.  The  difficulty  of  identifying  a  gradually  changing 
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transient  mean  function,  as  exhibited  by  many  queueing  systems,  still 
remains  unresolved*  The  use  of  the  point  of  maximum  cusum  deviation 
as  a  truncation  point  also  needs  additional  analytical  and  empirical 
investigation.  Combining  information  obtained  from  the  cusum 
statistic  with  well-known  heuristic  truncation  rules  could  prove  to  be 
useful  in  practice. 

When  K  is  large,  the  screening  of  alternatives  by  a 
generalized  subset  selection  algorithm  would  be  an  effective  means  of 
reducing  the  required  simulation  run-lengths  for  all  alternatives. 
This  would  be  especially  effective  if  for  example  the  final  subset  of 
maximum  size  M  were  required  to  contain  the  L  best  of  K  covariance 
stationary  processes.  Ensuring  that  the  L  best  alternatives  are 
selected  with  probability  P*  would  reduce  the  field  of  candidates  but 
still  give  the  user  flexibility  in  making  the  final  selection. 

As  a  refinement  of  the  procedure  developed  in  this  research, 
guidelines  for  setting  the  initial  sample  size  nQ  should  be 
formulated.  During  the  experimental  evaluation  of  the  multiple 
ranking  routines,  it  was  observed  that  small  initial  sample  sizes  were 
consistently  associated  with  over  estimates  of  p(0)  and  hence  with 
unnecessarily  large  run-lengths.  Additionally,  results  obtained 
during  this  research  have  indicated  the  need  to  consider  the  ratio 
max  ([p1(0)J1/2  :  i  -  1,  ...,  K>  /  A* 
when  selecting  the  initial  sample  size.  A  well  designed  set  of 
experiments  could  pinpoint  relevant  "rules  of  thumb"  to  assist  the 
user  in  applying  the  MRP. 
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Finally,  with  the  increasing  application  of  simulation 
modelling  in  the  nonacademic  arena,  additional  effort  to  make  the 
support  routines  developed  in  this  research  more  "user  friendly”  would 
greatly  expand  the  number  of  potential  users. 


APPENDIX  A 
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C  **  INTRODUCTION 

C  **  THIS  PROGRAM  CALCULATES  A  TEST  STATISTIC  FOR  TESTING  A  COMPLETE 
C  **  SAMPLE  FOR  NORMALITY.  THE  TEST  STATISTIC  IS  OBTAINED  BY  DIVIDING 
C  **  THE  SQUARE  OF  AN  APPROPRIATE  LINEAR  COMBINATION  OF  THE  SAMPLE  ORDER 
C  **  STATISTICS  BY  THE  USUAL  SYMMETRIC  ESTIMATE  OF  VARIANCE.  THIS  RATIO 
C  **  IS  BOTH  SCALE  AND  ORIGIN  INVARIANT  AND  HENCE  THE  STATISTIC  IS 
C  **  APPROPRIATE  FOR  A  TEST  OF  THE  COMPOSITE  HYPOTHESIS  OF  NORMALITY 


C  **  THIS  TEST  WAS  DEVELOPED  BY  S.  S.  SHAPIRO  AND  M.  B.  WILK 
C  **  A  DESCRIPTION  OF  THE  DEVELOPMENT  APPEARS  IN  BIOMETRIKA  (1965) 
C  **  VOL  52  PAGES  591-611. 


C  **  INCLUDED  IN  THIS  PROGRAM  IS  A  ROUTINE  TO  GENERATE  AN  ARMA( P, Q ) 

C  **  PROCESS  FOR  USE  AS  A  TEST  SAMPLE.  PARAMETERS  OF  THE  GENERATED 
C  **  TEST  SEQUENCE  MAY  BE  VARIED  BY  THE  USER. 


PROGRAM  WILK  ( TTY, OUTPUT, TAPE5=TTY, TAPE6=TTY, TAPE7, TAPE8, TAPE9 ) 
SHAPIRO-WILK  TEST  FOR  NORMALITY 
COMMON/BOX/OBS( 32,50) 

COMMON  /ABC/  N, J , K, SSQ, I NDCOL( 50 ) , X( 200 ) , W 
DOUBLE  PRECISION  DSEED 

DATA  I NDCOL/O, 0, 0,1,3,5,8,11,15, 19,24,29,35,41,48,55,63,71,80,89,9 
19,109,120,131,143,155,168, 181,195,209,224,239,255,271,288,305,323, 
2341 , 360, 379, 399,419,440,461, 483,505,528,551 . 575,599/ 

INITIALIZE  VARIALBLES 

I  PR  =  0 

IROPT  =  1 

NSIZE  =  1 

DSEED  =  12345.00 

NREP  =  16 

N  =  NREP 

KROW  =  1 

NMAX  =  3 

WR I TE( 9, 150 ) 


C  **  BLOCK  TO  CALL  SUBROUTINE  WHICH  GENERATES  AN  ARMA( P, Q ) 
C  **  PROCESS  TO  TEST 

DO  1000  I  =  1 , NREP 

CALL  ARMAPQ  (DSEED, KROW) 

KROW  =  KROW  +  1 
DSEED  =  DSEED*3 . DO 
1000  CONTINUE 


noon  ooo  ono  onn  noon  on no 
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C  **  DO  LOOP  TO  BATCH  OBSERVAT I ONS--START I NG  WITH  BATCH 
C  **  SIZE  =  1.  LOOP  WILL  BE  CALLED  IF  TEST  FAILS  FOR 
C  **  BATCH  UNDER  TEST  WITH  BATCH  SIZE  INCREASED  BY  1 

nil  DO  10  I  =  1, NREP 
SUM  =  0.0 
DO  20  J  =  1.NSIZE 

SUM  =  SUM  *  OBS( l,J) 

WRI TE( 9, *) I , J, 0BS( I , J ) 

20  CONTINUE 

AVG  =  SUM/NS  I ZE 
X( I )  =  AVG 
10  CONTINUE 


**  PRINT  HEAOER  -  NO.  OF  OBSERVATIONS 
WRITE  (9,160)  N 


**  SORT  DATA  POINTS  IN  ASCENDING  ORDER 

CALL  QSORT  (X,N) 

**  CALCULATIONS 

IF  (N.LE.50)  J=(NOCOL(N) 

K=N/2 

SUM=0. 

SSQ-0. 

DO  60  l  =  1,N 

SOM=SL>M*X(  I  ) 

60  SSQ=SSQ+X( I )*X( I ) 

SSQ= SSQ- SUM* SUM/ N 

**  PRINT  ORDERED  DATA  IF  NEEDED 

IF  ( IPR.NE.O)  GO  TO  70 
WRITE  (9,180) 

WRITE  (9,120)  (X( I ) , 1=1 , N) 

WRITE  (9,190) 

**  GET  W  STATISTIC  ** 

70  IF  (N.LE.50)  CALL  TEST 


**  PERFORM  SOME  SPACING 
WRITE  (9,210) 

IF  (IPR.NE.O)  WRITE  (9,220) 

IF  ( IPR.EQ.0.AND.N.LE.30)  WRITE  (9,230) 
IF  ( IPR.EQ.0.AND.N.GT.30)  WRITE  (9,240) 


onn  o  o  nnnn  non 
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**  PRINT  CRITICAL  VALUES  IF  NEEDED 
CALL  CRITVAL(N.CRIT) 


**  IF  NORMALITY  HYPOTHESIS  IF  REJECTED  INCREASE 
**  BATCH  SIZE  (NSIZE)  BY  1  AND  RETEST 


IF(W  .LT.  CRt T )THEN 
WR I  TE(  9, 190) 

WRITE(9,*) 'NORMALITY  REJECTED  WITH  NSIZE  =’, NSIZE 
WRITE(9,220 ) 

IF  (NSIZE  .GE.  NMAXJTHEN 

WRITE(9,*)'NSIZE  TO  LARGE  TO  USE  THIS  DATA  SAMPLE' 

STOP 
END  IF 

NSIZE  =  NSIZE  +  1 
GO  TO  1111 
END  IF 
STOP 

120  FORMAT ( 5( 5X, E14 . 4  )  ) 

150  FORMAT  ( 1H1 ,  40H  SHAPIRO  AND  WILK  W  TEST  FOR  NORMALITY,/) 
160  FORMAT  (26X, 13,  13H  OBSERVATIONS,/) 

180  FORMAT  (27X,  12H0RDERED  DATA,/) 

190  FORMAT  (//) 

200  FORMAT  (////////) 

210  FORMAT  (1H  ) 

220  FORMAT  (//////) 

230  FORMAT  (///) 

240  FORMAT  (//) 

END 


SUBROUTINE  TEST 

**  THIS  SUBROUTINE  CALCULATES  THE  SHAPIRO-WILK  W  STATISTIC  ** 

COMMON  /ABC/  N, J , K, SSQ, I NDCOL( 50 ) , X( 200 ) , W 
COMMON  /COEF/  A(625) 

C 

B=0 

DO  10  1=1, K 

10  B=B+A(  J+l  )*(X(  N-  1+1  )-X(  I  )  ) 

W=B*B/SSQ 
WRITE  (9,20)  W 
RETURN 
C 

20  FORMAT  (19X,  1 7HSHAP I RO-W I LK  W  =  ,F6.4) 

C 

END 


r.WL.t 
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c 

c 

c 

c 


c 


c 


SUBROUTINE  CRITVAL  (N.CRIT) 

**  PRINT  THE  CRITICAL  VALUES  FOR  THE  W  TEST 

COMMON  /CRIT/  T(50, 1  ) 

WRITE  (9,50) 

WRITE  (9,60)  N,T(N,1) 

WRITE  (9,90) 

CRIT  =  T(N, 1  ) 

RETURN 

50  FORMAT  (19X,  28HCR I T I  CAL  VALUE  OF  THE  W-TEST) 

60  FORMAT  (/12X,  41HN  0.10  ,//H3, 

1F8.3//) 

90  FORMAT  ( //16X,  44HN0TE  THAT  SMALL  VALUES  OF  W  ARE  S I GN I F ICANT, , /16 
IX,  48HI.E.,  LEAD  TO  REJECTION  OF  THE  NORMAL  HYPOTHESIS) 


ENu 

BLOCK  DATA  W 

COMMON  /COEF/  A( 200 ) , C( 200 ) , D( 200 ) , F ( 25 ) 

COMMON  /CRIT/  T(50,1 ) 

DATA  A/. 7071, .6872, . 1677,-6646, . 241 3, . 6431 ,. 2806, . 0875, . 6233, . 303 1 

1. . 1401. .6052..3164. .1743. . 0561 .. 5888. . 3244. . 1976. . 0947. . 5739. . 3291 

2. . 2141. . 1224. .0399. .5601. .3315. .2260. . 1429. . 0695. . 5475. . 3325. . 2347 

3. .  1586. .0922. .0303. .5359. . 3325. .2412. .1707. . 1 099. . 0539. . 5251 .. 3318 

4. . 2460. . 1802. .1240. .0727. .0240. .5150. .3306. .2495. .1878. .1353,-0880 

5. . 0433. .5056. .3290. .2521. . 1939. . 1447. . 1005. . 0593. . 0196. . 4968. . 3273 

6. . 2540. .1988. . 1 524. . 1 109. . 0725. . 0359. . 4886. . 3253. . 2553. . 2027. .1587 

7. . 1197. .0837,-0496, .0163,-4808, . 3232, . 2561 , . 2059, . 1641 , . 1 271 , . 0932 

8. . 0612. .0303. .4734. .3211. .2565. .2085. . 1686. . 1334. . 101 3. . 071 1 . . 0422 

9. . 0140. .4643. .3185. .2578. .21 19. .1736. .1399. . 1092. .0804. .0530. .0263 
*, .4590, .3156, .2571, .2131, . 1764, . 1443, . 1150, .0878, .0618, .0368, .0122 
*, .4542. .3126, .2563,-2139, . 1787, . 1480, . 1201, .0941 , .0696, .0459, .0228 
*, .4493, .3098, . 2554, . 21 45, . 1807, . 1 51 2, . 1245, . 0997, . 0764, . 0539, . 0321 
*, .0107, .4450, . 3069, .2543, .2148, . 1822, .1539, . 1283, . 1046, .0823, .0610 
*, .0403, .0200, .4407, .3043, .2533, .2151, . 1836, . 1563, . 1316, . 1089,-0876 
*, .0672, .0476, .0284, .0094, .4366, .3018, .2522, .2152, . 1848, .1584, .1346 
*, .1128, .0923, .0728, .0540, .0358, .0178, .4328, .2992, .2510, .2151 , . 1857 
*, .1601, .1372, .1162, .0965, . 0778, . 0598, . 0424, .0253, .0084, .4291, .2968 
*. .2499, .2150/ 

DATA  C/. 1864, . 1616, . 1 395, . 1 192, . 1002, .0822, .065,-0483, .032, .0159, . 

14254. . 2944. .2487. .2148. . 1870. . 1630. . 1415. . 1219. . 1036. .0862. .0697. . 

20537. . 0381. .0227. .0076. . 4220. . 2921 .. 2475. .2145. . 1874. .1641. . 1433. . 

31243. .  1066. .0899. .0739. .0585. .0435. .0289. .0144. . 4 188. . 2898. . 2463. . 

42141. .  1878. .1651. . 1449. .1265. . 1093. .0931. .0777. .0629. .0485. .0344. . 

50206. . 0068. .4156. .2876. . 2451 . . 21 37. . 1 880. .1660. . 1463. . 1284. .1118. . 

60961. . 0812. .0669. .0530. .0395. .0262. . 01 3 1 . . 41 27 . . 2854. .2439. .2132. . 

71882. .  1667. .  1475, . 1301, . 1 1 40, . 0988, . 0844, . 0706,  . 0572,  . 0441 ,. 0314,  . 

80187. . 0062. .4096. .2834. . 2427. . 21 27. . 1 883 . .1673. .1487. . 1317. . 1160. . 

91013. . 0873. .0739. .0610. . 0484. . 0361 .. 0239 .. 01 19. . 4068. . 281 3. . 241 5. . 
*2121, .1883, .1678, .1496, . 1 331 , . 1 1 79, . 1 036, .0900, .0770, .0645, .0523, . 
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*0404, .0287, .0172, .0057, . 4040, . 2794, . 2403, .2116, . 1883, . 1683, .1505, . 
*1344, .1196, .1056, .0924, .0798, . 0677, . 0559 , .0444, .0331,. 0220, .0110, . 
*4015,-2774, .2391, .2110, .1881, . 1686, .1513, .1356, . 1211, . 1075, .0947, . 
*0824, .0706, .0592, .0481, .0372, .0264, .0158, . 0053, . 3989, . 2755, . 2380, . 
*2104, . 1880, . 1689, . 1520, .1366, . 1225, . 1092, . 0967, . 0848, . 0733 ,. 0622, . 
*0515, .0409, .0305, .0203, .0101, .3964, .2737, .2368, .2098, .1878, . 1691, . 
*1526, . 1376, .1237, .1108, .0986, .0870, .0759, .0651, .0546, .0444, .0343, . 
*0244, .0146, .0049/ 

DATA  D/. 394, .2719, .2357, .2091 ,. 1 876, . 1693, . 1 531 ,. 1 384 , .1249, .1123, 

1.1004. . 0891. .0782. .0677. .0575. .0476. . 0379. . 0283 . . 0188. . 0094. . 391 7, 

2.2701. . 2345. .2085. . 1874. . 1694. . 1535. .1392. . 1259. . 1136. . 1020. .0909, 
3.0804,  .0701, .0602, .0506, .0411, .0318, .0227, .0136, .0045, .3894, .2684, 

4.2334. . 2078. . 1871. . 1695. .1539. . 1 398 . . 1 269. . 1 149. . 1035,-0927, .0824, 
5.0724, .0628, .0534, . 0442, . 0352, . 0263 , . 01 75 ,. 0087, . 3872, . 2667, . 2323 , 

6.2072. .  1868. . 1695. . 1542. . 1405. . 1278. . 1160. .1049. .0943. .0842. .0745, 
7.0651, .0560, .0471, .0383, .0296,-0211, .0126, .0042, .3850, .2651,-2313, 

8.2065. .  1865. . 1695. . 1 545. . 1410. . 1 286 . . 1 1 70. . 1062. .0959. .0860. .0765, 
9.0673, .0584, .0497, .0412, .0328, .0245, .0163, .0081, . 3830, .2635, .2302, 
*.2058. . 1862, . 1695, . 1548, . 1415, . 1293, . 1180, . 1073, .0972. .0876, .0783, 
*.0694, .0607, .0522, .0439, .0357, . 0277, .0197, .0118, .0039, .3808, .2620, 
*.2291 ,  .2052, . 1859, . 1695, .1550, .1420, .1300, .1189,. 1085, . 0986, .0892, 
*.0801 , .0713, .0628, .0546, .0465, .0385, .0307, .0229, .0153, .0076, . 3789, 
*.2604,  .2281, .2045, .1855, . 1693, . 1 551 , . 1 423 , .1306, . 1197, . 1095, . 0998, 
*.0906, .0817, .0731, .0648, .0568, .0489, .0411, .0335, .0259,-0185, .0111, 
*.0037, .3770, .2589, .2271, .2038, . 1851 , . 1692, . 1 553, . 1427, . 1 312, . 1205, 
*.1105, . 1010, .0919, .0832, .0748, .0667, .0588, .0511, .0436, .0361, .0288, 
*.0215, .0143, .0071/ 

DATA  F/ . 3751 ,. 2574, . 226, . 2032, . 1847, . 1691 , . 1 554, . 143, . 1 31 7, . 121 2, . 

11113. . 1020. .0932. .0846. .0764. .0685. .0608. .0532. .0459. .0386,  .0314,  . 

20244. . 0174. .0104. .0035, 

DATA  T/0. ,0. , .789, .792, .806, .826, .838, .851, .859, .869, .8 
*76, .883, .889, .895, .901, .906, . 910, . 914, . 91 7, .920,-923, .926, .928, .93 
*0, .931, .933, .935, .936, .937, .939, .940, .941, .942, .943, .944, .945, .946 
*, .947,-948, .949, .950, .951,-951, .952, .953, . 953, . 954, . 954, . 955, .955/ 

END 

SUBROUTINE  QSORT  (X,N) 

QUICKSORT  ALGORITHM. 

DIMENSION  X( 1  ),  STACK( 13,2) 

INTECER  STACK, FIRST 

REAL  MEDIAN, MED 

DATA  MAXSTK/13/, K/12/.M/10/ 

I  TOP=0 
F I RST=1 
NN=N 

10  CONTINUE 

IF  (NN.GT.M)  GO  TO  20 
CALL  SHLSRT  ( X( F I RST ) , NN ) 

IF  ( ITOP.LE.O)  GO  TO  130 
F I RST=STACK( I  TOP, 1 ) 

NN=STACK( I  TOP, 2) 

I TOP= I  TOP-1 
GO  TO  10 


ooo 


20  CONTINUE 

LAST  =  F I RST  +NN- 1 

N1=0 

N2=0 

MED  I AN=MED( X( F I RST ) , NN ) 

M  =  F  I  RST 
I2=LAST+1 
30  CONTINUE 
1=12-1 

40  CONTINUE 

IF  ( I.LE. II)  GO  TO  80 
IF  (X( I ). LT. MEDIAN)  GO  TO  50 
1  =  1-1 
N2=N2+1 
CO  TO  40 
50  12=1 

X(  1 1 )=X( 12) 

N1=N1+1 

1=11+1 

60  CONTINUE 

IF  ( I .GE. 12)  GO  TO  90 
IF  (X( I ) .GT. MEDIAN)  GO  TO  70 
1  =  1+1 
N1=N1+1 
GO  TO  60 
70  11=1 

X(  1 2 )=X(  II ) 

N2=N2+1 
GO  TO  30 
80  X( II )=MEDIAN 
GO  TO  100 
90  X(  1 2 )=MED I  AN 
100  CONTINUE 

l TOP=  t  TOP+1 

IF  ( ITOP.GT.MAXSTK)  GO  TO  120 
IF  (N1.GT.N2)  GO  TO  110 
STACK( I  TOP, 1 )  =  LAST-N2+1 
STACK) I  TOP, 2 )=N2 
NN=N1 
GO  TO  10 

110  STACK) ITOP, 1 )=F I RST 
STACK)  I  TOP,  2  )=N1 
F I RST=LAST-N2+1 
NN=N2 
GO  TO  10 

120  CALL  REMARK  ( 24LSTACK  OVERFLOW  IN  QSORT  ) 
STOP  ' 

130  RETURN 
C 

END 

SUBROUTINE  SHLSRT  (X.N) 

SHELL  SORT. 

DIMENSION  X) 1 ) 


ono 


120 


M—  N 

10  CONTINUE 
M=M/2 

If  (M.EQ.O)  GO  TO  50 
K=N-M 
J  =  1 

20  CONTINUE 
l=J 

30  CONTINUE 
L=M+  I 

IF  (X( I ).LE.X(L) )  GO  TO  40 
XK=X( I ) 

X( I )=X( L ) 

X(L)=XK 
I  =  I  -M 

IF  (I.CE.1)  GO  TO  30 
40  CONTINUE 
J=J  +  1 

IF  (J-K)  20,20,10 
50  CONTINUE 
RETURN 

END 

FUNCTION  MED  (X,N) 

FUNCTION  TO  GET  A  MEDIAN  ESTIMATE  OF  AN  ARRAY. 

REAL  MED 
DIMENSION  X( 1 ) 

M I D=N/2 
XF=X(  1  ) 

XM=X( MID) 

XL=X(N) 

IF  (XF.GT.XM)  GO  TO  10 
IF  (XM.LT.XL)  GO  TO  30 
IF  (XF.LT.XL)  GO  TO  40 
GO  TO  20 

10  IF  (XM.GT.XL)  GO  TO  30 
IF  (XF.GT.XL)  GO  TO  40 
20  K=1 

GO  TO  50 
30  K=M  I  D 
GO  TO  50 
40  K=N 
50  MED=X( K ) 

X( K)=X( 1 ) 

RETURN 

END 


C  **  SUBROUTINE  TO  GENERATE  ARMA( P,Q)  PROCESS  FOR  TEST 
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SUBROUTINE  ARMAPQ( SEED, KROW) 

COMMON/BOX/T£ST( 32, 50) 

COMMON/TSER I ES/DELTA( 3 ) , S I GMA( 3 ) , NSAMP( 3 ) , I P ( 3 ) , JQ( 3 ) , 
1THETA(3,48),X(3,60),U(3,60), I0LD( 3 ) , J0LD( 3 ) , PH  I ( 3, 48 ) , 

20NE( 1 ) , DSEED 

DOUBLE  PRECISION  DSEED, SEED 
INITIALIZE 
DSEED  =  SEED 
DELTA( 1 )  =  110.0 
S I  CM A ( T )  =  20.0 
I  P(  1  )  =  2 
JQ(  1  )  =  0 
PH  I ( 1 , 1 )  =  0.35 
PHI (1,2)  =  0.25 
PH  I (1,3)  =  0.0 
THETA( 1,1 )  =  0.0 
THETA( 1,2)  =  0.0 
THETA( 1,3)  =  0.0 
NR  =  1 

START  =  ARMA( 0, 1 ) 

DO  100  1=1,1000 

CALL  GGNML( DSEED, NR , ONE ) 

CLEAR  =  ARMA( 1,1) 

100  CONTINUE 

DO  200  1=1,50 

CALL  GGNML( DSEED, NR, ONE) 

TEST( KROW, I )  =  ARMA( 1,1) 

200  CONTINUE 
RETURN 
END 

FUNCTION  ARMA( IND.KS) 

C  ***  GENERATE  ARMA  (P,Q)  MODELS 

C  ***  GENERATOR  USES  ARRAYS, X( SER I ES)  &  U(WHITE  NOISE  SERIES), 

TO  ACCOUNT  FOR  DEPENDENT  PAST  VALUES.  IOLD  AND  JOLD  POINT  TO 
THE  OLDEST  ELEMENT  IN  EACH  ARRAY.  NEWEST  ELEMENT  IS  ONE 
ELEMENT  OVER. 

COMMON/TSER I ES/OELTA( 3 ) , S I GMA( 3 ) , NSAMP( 3 ) , I P( 3 ) , JQ( 3 ) , 

1 THETA( 3 , 48 ) , X( 3, 60 ) , U( 3, 60 ) , IOLO( 3 ) , JOLD( 3 ) , PH  I ( 3, 48 ) 

2,0NE( 1 ), DSEED 
DOUBLE  PRECISION  DSEED 

***  FIRST  TIME  THROUGH  ( I ND=0 ) ,  INITILIZE  VARIABLES.  OTHERWISE, 

GO  TO  100  AND  GENERATE  SERIES. 

I F ( IND.EQ.1)  GO  TO  100 
N  I  P=  I  P(  KS ) 

NJQ=JQ( KS ) 

XMU  =  DELTA(KS) 

SUM  =1.0 
C  ***  CALCULATE  MAXIMUM  LAG,  LMAX 
LMAX  =  MAXO( Nl P.NJQ) 

C  ***  CALCULATE  MEAN  (XMU)  OF  SERIES 
IF  (NIP  .EQ.  0)  GO  TO  20 
00  10  1=1 ,NI P 
10  SUM  =  SUM  -  PHI ( KS, I ) 

20  XMU  =  DELTA( KS )/SUM 

C  ***  INITIALIZE  OLDEST  ELEMENT  POINTERS,  IOLD  k  JOLD,  FOR  SERIES  (X) 
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C  *** 


k  WHITE  NOISE  SERIES  (U)  TO  LAST  ELEMENT  IN  EACH  ARRAY 
I0LD(KS)  =  NIP 
JOLD(KS)  =  NJQ 
DO  30  LAC= 1 , LMAX 

INITIALIZE  WHITE  NOISE  SERIES  TO  MEAN  (0.) 

U( KS, LAG )  =  0.0 

INITIALIZE  SERIES  (X.ARMA)  TO  MEAN  ( XMU ) 

X( KS, LAG )  =  XMU 
ARMA  =  XMU 
RETURN 

WHITE  NOISE  (UO)  IS  N0RMAL( 0 . , S I GMA ) 

CALL  GGNML( DSEED, NR, ONE ) 

UO  =  SIGMA(KS)*ONE(KS) 

ARMA  =  DELTA(KS)  +  UO 

IF  ARMA  NOT  DEPENDENT  ON  PAST  SERIES  VALUES  (X),  DON’T 
ADO  THEM  ON 

ARMA  DEPENDS  ON  WHITE  NOISE  PLUS  DELIA  TO  BRING  SERIES 
UP  TO  MEAN 

IF  ( I P( KS)  . EQ.  0)  GO  TO  150 

GET  PAST  SERIES  ELEMENTS  (X)  IN  ORDER,  FROM  LAST  TO 
OLDEST 

DO  120  I  1  =  1 ,  I  P<  KS) 

I  =  MOD( I 0LD( KS)  +  I I , I P( KS) ) 

IE  (  I  .  EQ.O)  I  =  I  P(  KS  ) 

ADD  TO  ARMA  PAST  SERIES  VALUES(X)  TIMES  PHI  ARRAY 
ARMA  =  ARMA  ♦  PH  I ( KS ,  I  I  ) *X( KS ,  I  ) 

IF  ARMA  NOT  DEPENDENT  ON  PAST  WHITE  NOISE  VALUES(U), 
DON'T  ADD  THEM  ON 
IE  (JQ(KS)  .EQ.  0)  GO  TO  500 

GET  PAST  WHITE  NOISE  VARIABLES  (U)  FROM  LAST  PERIOD 
TO  OLDEST 

DO  170  JJ= 1 , JQ( KS ) 

J  =  M0D( JOLD( KS ) +J J , JQ( KS ) ) 

IE  (J.EQ.O)  J=JQ( KS ) 

SUBTRACT  PAST  WHITE  NOISE  VARIABLES(U)  TIMES  THETA  ARRAY 
ARMA  =  ARMA  -  THETA( KS, J J ) *U( KS, J ) 

IE  ARMA  IS  DEPENDENT  ON  PAST  SERIES  VALUES  (X),  SAVE 
ARMA  WHERE  OLDEST  X  ELEMENT  IS. 

IF  ( IP(KS)  .EQ.  0)  GO  TO  550 
X( KS, I 0LD( KS) )  =  ARMA 

UPDATE  I  OLD  WHERE  I  OLD  IS  BETWEEN  1  AND  P 

IOLD(KS)  =  IOLD(KS)  -  1 

IF  (lOLD(KS)  .EQ.  0)  IOLO(KS)  =  IP(KS) 

IF  ARMA  NOT  DEPENDENT  ON  PAST  WHITE  NOISE,  DON'T  UPDATE 
U  ARRAY 

IF  (JQ(KS)  .EQ.  0)  RETURN 

SAVE  CURRENT  WHITE  NOISE  (UO)  WHERE  OLDEST  WHITE  NOISE 
HAD  BEEN 

U( KS, JOLD( KS) )  =  UO 
UPDATE  JOLD 

JOLD(KS)  =  JOLD(KS)  -  1 

IE  (JOLD(KS)  .EQ.  0)  JOLD(KS)  =  JQ(KS) 

RETURN 

END 


APPENDIX  B 
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C  **  PROGRAM  IBZERO  IS  USED  TO  DETECT  THE  PRESENCE  TO  INITIALIZATION 
C  **  BIAS  AND  AUTOMATICALLY  TRUNCATE  THE  DATA  UNDER  TEST. 

C  **  THE  DATA  TO  BE  TESTED  SHOULD  BE  NAMED  TAPE8 .  IT  WILL  BE  READ 
C  **  AFTER  THE  USER  ANSWERS  QUESTIONS  PROMPTED  ON  THE  CRT. 

C  **  THE  DATA  TO  BE  TESTED  MAY  BE  BATCHED  PRIOR  TO  ANY  TEST  BEING 
C  **  CONDUCTED  BY  CHANGING  THE  DATA  ELEMENT  -NSIZE-  NSIZE  IS  PRESENTLY 
C  **  SET  AT  1  (NO  BATCHING). 

C  **  THIS  PROGRAM  IS  A  MODIFICATION  OF  A  TESTED  DESIGNED  BY  L.  SCRUBEN 
C  **  AS  REPORTED  IN  VOL  30  MAY  1982  OPERATIONS  RESEARCH. 

C  **  THE  REQUIRED  ESTIMATE  OF  THE  DATA  VARIANCE  IS  MEASURED  BY 
C  **  USING  THE  SPECTRAL  METHOD 

C  **  INCLUDED  IN  THE  PROGRAM  ARE  TO  PLOT  SUBROUTINES 
C  **  THESE  ARE  USED  TO  PLOT  THE  BATCH  MEANS  AND  THE  CUSUMS 

PROGRAM  I BZERO( TTY, OUTPUT, TAPE5=TTY, TAPE6=TTY, TAPE7, TAPE8, TAPE9 ) 
DIMENSION  DATA( 2000 ) 

COMMON//PLT( 2000 ) , NUMBAT, BATCH( 2000 ) 

DATA  NSIZE/1/ 


#**»*REQUEST  USER  INPUT  FROM  TERMINAL 
*#*#*NUMBER  OF  DATA  POINTS  IN  F I LE{ TAPES ) 

AGAIN  =  0.0 

WRITE(6,*) 'ENTER  NUMBER  OF  DATA  POINTS' 

READ( 5, *  JOBS 
LENTH  =  IFIX(OBS) 

***** REQUEST  USER  INPUT  FROM  TERMINAL 
*****THE  PRESPECIFIED  LEVEL  OF  SIGNIFICANCE 

60  WRITE(6,*) 'ALPHA  =  ' 

READ( 5, * (ALPHA 

*****CHECK  THAT  USER  INPUT  PROPER  DATA  TYPE 

I F( (ALPHA  .LE.  0.)  .OR. (ALPHA  .GE.  1.0) (THEN 
WR I TE( 6, 52 ) 

52  FORMAT(/, 'YOUR  VALUE  FOR  ALPHA  IS  INCORRECT.', 
+  ’  PLEASE  REENTER. '  ) 

GO  TO  60 
END  IF 

*****  initialize  variables 

OBS  =  LENTH 
JUNK  =  0 
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I  BEG  IN  =  1 
MPOINT  =  0 
I  END  =  NSIZE 
ITRUNC  =  0 
KOUNT  =  0 


***#*00  LOOP  TO  LOAD  DATA  INTO  ARRAY  FOR  PROCESSING 

I F ( AGA I N  .NE.  O.OJTHEN 
GO  TO  75 
END  IF 

READ( 8, *, ERR=901 )  ( DATA( I ), 1=1 , LENTH ) 


75  NUMBAT  =  OBS/NSIZE 
NSTART  =  I  BEG  IN 
POINTS  =  FLOAT (NUMBAT) 

KOUNT  =  KOUNT  +  1 

NFIN  =  I  END 

DO  150  k=1, NUMBAT 

BATSUM  =0.0 

DO  100  l=NSTART,NFIN 

BATSUM  =  BATSUM  +  DATA( I ) 

100  CONTINUE 

**###COMPUTE  MEAN  OF  EACH  BATCH 

BATCH(K)  =  BATSUM/NSIZE 
NSTART  =  NSTART  +  NSIZE 
NFIN  =  NFIN  +  NSIZE 
150  CONTINUE 


*****CALL  SUBROUTINE  TO  PLOT  BATCH  MEANS 
I F( KOUNT  .EQ.  1 JTHEN 

WRITE! 9,*)' FOLLOWING  IS  A  PLOT  OF  BATCH  MEANS' 
CALL  P BATCH 
END  IF 

*****COMPUTE  SUM  OF  SAFE  BATCH  MEANS 

TOT  =0.0 
NHALF  =  NUMBAT/2 
MID  =  NHALF  +  1 
NSAFE  =  NUMBAT  -  NHALF 


mi*  CALL  SUBROUTINE  WELCH  TO  CALCULATE  VARIANCE  mtmmmiHm 


CALL  WELCH! MID, ZERO) 

WR I TE( 9, * )  ZERO  =',ZERO 
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DO  200  I =M I D, NUMBAT 
TOT  =  TOT  ♦  BATCH ( I ) 
200  CONTINUE 


GAMMA  =  ZERO 

'** INITIALIZE  VARIABLES  USED  DURING 
**EACH  PASS  THROUGH  THE  DATA 


AMAX  =0.0 
CUSUM  =0.0 
PMEAN  =0.0 
AMIN  =  0.0 
PSUM  =  0.0 
M  =  0 

NEGTIV  =  0 
POST  IV  =  0 
TOTAL  =0.0 

**#**COMPUTE  MEAN  OF  ALL  DATA 

DO  325  I  =  1, NUMBAT 

TOTAL  =  TOTAL  +  BATCH ( I ) 

325  CONTINUE 

AMEAN  =  TOTAL/NUMBAT 
I F ( KOUNT  . EQ .  1 ) TMEAN=AMEAN 
WR I TE( 9. 326 ) KOUNT. AMEAN, TMEAN 

326  FORMAT ( /, 5X, 1  PASS  NUMBER', 15, ‘  MEAN= ' , F10 . 4, '  TMEAN=' , F10.4 ) 


*****TEST  FOR  INITIALIZATION  BIAS 
*****FIND  MOST  POSITIVE  AND  NEGATIVE 
*****VALUES  OF  NORMALIZED  CUSUM 

SIGMA  =  SQRT (GAMMA) 

SQROOT  =  SQRT( POINTS) 

DO  500  1=1, NUMBAT 
M  =  M+1 

PSUM  =  PSUM+BATCH( I ) 

PMEAN  =  PSUM/M 
CUSUM  =  AMEAN- PMEAN 

#***#BLOCK  TO  CHECK  FOR  NEGATIVE  VALUES  OF  CUSUM 
*****AND  SAVE  MOST  NEGATIVE  VALUE 

I F ( CUSUM  .LT.  0.0) THEN 
NEGTIV  =  1 

SNEG  =  (M*CUSUM)/ SQROOT 
PLT( I )  =  SNEC/SIGMA 
I F( SNEG. LT. AM  I N )THEN 
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AM  I N=SNEG 
NEGLOC  =  M 
END  IF 
GO  TO  500 
ENO  IF 


STAR  =  ( M*CUSUM ) /SQR00T 
PLT ( I )  =  STAR/SIGMA 

I F( STAR  .CT.  AMAX) THEN 
POST  IV  =  1 
AMAX  =  STAR 
MPOINT  =  M 
END  IF 
500  CONTINUE 

###*#PI_0T  S  VALUES****** 

WRITE(9,*) ' FOLLOWING  IS  A  PLOT  OF  STAR  DURING  PASS', KOUNT 
CALL  PSTAR 

*****BLOCK  TO  CHECK  IF  ONLY  POSITIVE 
*****  INITIAL  BIAS  INDICATED 

I F( ( NEGT IV  .GT.  0)  .AND. 

+( POST  I V  .LT.  1.0) )THEN 

WRITE(9,*) ' IND1CAT IONS  OF  POSITIVE  BIAS  ONLY  DURING  PASS', KOUNT 
AMAX  =  AMIN 
MPOINT  =NEGLOC 
GO  TO  501 
END  IF 

*****BLOCK  TO  CHECK  IF  OSCILLATION  OF 
*****NEGATIVE  AND  POSITIVE  BIAS  INDICATED. 

*****STANDARDIZE  TO  UNIT  INTERVAL. 

*****CHECK  USING  SAME  SCHRUBEN  TEST 
***** EXCEPT  USING  ALPHA/2. 

I F( ( NEGT IV  .GT.  0 ) . AND. ( POST  I V. GT . 0 ) )THEN 

WRITE(9,*J ' INDICATION  OF  «■  AND  -  BIAS  DURING  PASS', KOUNT 
TN  =  FLOAT ( NEGLOC )/P0 1  NTS 
TP  =  FLOAT (M POINT)/ POINTS 
XP=(AMAX**2)/(3*GAMMA*TP*< 1-TP) ) 

XN=(  AMI N**2 )/( 3*GAMMA*TN*{ 1 -TN ) ) 

DFN  =3. 

DFD=PO I  NTS/2 
X  =  XP 

CALL  MDFDRE( X, DFN, DFD, P, I ER ) 

PROPOS  =  1.  -  P 
X  =XN 

CALL  MDFDRE(X,DFN,OFD, P, IER) 

PRONEG  =  1.0  -  P 
HALPHA  =  ALPHA/2. 

I F(( PROPOS  .AND. PRONEG) 
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♦  .LT.  HALPHA ) THEN 

MPO I NT=MAXO (MPOI NT, NEGLOC ) 

GO  TO  913 
ENO  IF 

I F( ( PROPOS  .AND.  PRONEG) 

+  .GE.  HALPHA (THEN 

GO  TO  974 
END  IF 

I F( PROPOS  .LT.  HALPHAJTHEN 
GO  TO  913 

ELSE 

MPOI NT  =  NEGLOC 
GO  TO  913 
END  IF 
END  IF 

*#*#*BLOCK  TO  CALCULATE  VIA  SCHRUBEN 
*****BROWNIAN  BRIDGE  TEST  INDICATION 
**##*OF  INITIAL  BIAS  OF  ONLY  ONE  SIGN 

WRITE(9,*) ' INDICAT  IONS  OF  ONLY  -  BIAS  DURING  PASS  ’ , KOUNT 
501  T  =  FLOAT (MPO INT)/ POINTS 

X  =  ( AMAX**2 )/( 3 . *GAMMA*T*( 1 . — T ) ) 

DFN  =  3. 

DFD  =  POINTS/2 

CALL  MDFDRE( X, DFN, DFD, P, I ER ) 

I F( I ER  .EQ.  129  JTHEN 

WR I TE( 9, * ) ' I ER  ERROR' 

STOP 
END  IF 

PROBAB  =  1 . 0  -  P 
I F( PROBAB  .LT.  ALPHAJTHEN 

*****BLOCK  TO  OVERRIDE, IF  NECESSARY, 

*****TRUCATION  POINT  TO  ALLOW  AT  LEAST  TWO 
*****PASSES  TO  ELIMINATE  INITIAL  BIAS 
*****POlNT  =  . 25*DATA 


913  CONTINUE 

MAXPNT  =  I F I X( . 25*NUMBAT ) 

I F( MPO 1  NT  .GT.  MAXPNT )THEN 
MPO I  NT  =  MAXPNT 
END  IF 


•••«« | TRUNC  EQUALS  THE  TRUNCATION  POINT  OF  BATCHES 

ITRUNC  =  I TRUNC  +  MPO I  NT 

*****BLOCK  TO  SEE  IF  THE  TEST  PROCEDURE  HAS 
*****TRUNCATED  AN  EXCESSIVE  AMOUNT  OF  DATA 
#****(50%)  AND  STILL  NOT  ELIMINATED  INITIAL  BIAS 

JUNK  =  I TRUNC*NS I ZE 


nnn  n oo  nonnoo  oooo 
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WR I TE( 9, 924 )KOUNT, JUNK 

924  FORMAT!//, ' PASS  NUMBER', 13, 

+  '  THROUGH  THE  DATA  SHOWS  A  TRUNCATION  POINT  OF  ’,14) 

I F( JUNK  .CT.  (0.5*LENTH) JTHEN 
WRITE(9,925)JUNK 

925  FORMAT ( / ,  AN  EXCESSIVE  AMOUNT  OF  DATA) AT  LEAST', 13, 

+'  DATA  POINTS)  MUST  BE  TRUNCATED',/,'  TO  ELIMINATE  ', 
♦  ' INITIALIZATION  BIAS.  IT  IS  SUGGESTED  THAT  A',/, 

+'  LARGER  SAMPLE  BE  OBTAINED  AND  THE  TEST  RERUN') 

GO  TO  929 
END  IF 

•••♦•CALCULATE  NUMBER  OF  DATA  POINTS 
•••••LEFT  AND  RETEST  USING  ONLY  THESE  POINTS 

OBS  =  OBS  -  ( MPO I NT*NS IZE ) 

IBEGIN  =  IBEGIN  +  ( MPO I NT*NSIZE ) 

I  END  =  IBEGIN  +  (NSIZE  -  1 ) 

GO  TO  75 

ELSE 


•••••SHOW  FINAL  TRUNCATION  POINT 
•••••AND  COMPUTED  MEAN 

974  WR I TE( 9, 975  I ALPHA, JUNK 

975  FORMAT!///, 'THE  HYPOTHESIS  OF  NO  I N I  I AL I ZAT I  ON ' , 

+  '  BIAS  IS  NOT  REJECTED  AT  THE  PRESPECIFIED’,/, 

+  '  LEVEL  OF  SIGNIFICANCE  ',F5.4,'  WITH  A  TRUNCATION', 

+  '  POINT  OF  ' , 14) 

END  IF 

WRITE! 9,*)' MEAN  OF  RAW  DATA  -  ' , TMEAN 
WR I TE( 9,981 JAMEAN 

981  FORMAT!/, 'THE  ARITHMETIC  MEAN  OF  THE', 

+  '  TRUNCATED  DATA  =  '.FI 0.4) 

AGAIN  =  0.0 

*****ASK  if  rerun  WANTED  WITH  DIFFERENT  ALPHA  LEVEL 

929  WR I TE( 6, 930 ) 

930  FORMAT!//, 'DO  YOU  WANT  TO  RERUN  THE  DATA  WITH  A  ', 
♦'DIFFERENT  LEVEL  OF  SIGNIFICANCE?',/, 

♦'ENTER  0  FOR  NO’,/, 'ENTER  1  FOR  YES') 

READ! 6,*) AGAIN 
I F ( AGA I N  .GT.  0.0)THEN 
GO  TO  60 
END  IF 
STOP 

*****ERORR  MESSAGE 


901  WRITE! 6,*)' THERE  IS  A  DATA  ERROR  IN  YOUR  FILE.  PLEASE  RECHECK' 
STOP 
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END 


SUBROUTINE  PLOT 


SUBROUTINE  PSTAR 

COMMON// PLT ( 2000 ) , NUMBAT, BATCH ( 2000 ) 

WR  I  TE(  9, 201  ) 

201  FORMAT (//////) 

YB I G=  PLT( 1  ) 

YM I N=PLT ( 1 ) 

DO  100  1=2, NUMBAT 
I F( YM I N. LT . PLT ( I ) )CO  TO  50 
YM I N=  PLT (  I  ) 

50  CONTINUE 

I F( YBIG.GT. PLT( I )  )GO  TO  100 
YB I G=PLT ( I ) 

100  CONTINUE 

WR  I TE( 9, 350 ) ( 1H*,J  =  1,55) 

DO  200  1=1, NUMBAT 
I F( YBIG. EQ.YMINJTHEN 
L=IFIX(49.999*PLT( I )  )+2 
ELSE 

L= I F I X( 49. 999*( PLT ( I )  -YM I N )/( YBIG-YMI N ) )+2 
END  IF 

350  FORMAT ( 22X, 60A1 ) 

I F( PLT( I ) . GT . 0 . 0 ) THEN 

WRITE(9, 300)1, PLT( I ),(1H  , J=1 , L- 1 ) , 1 H+, ( 1 H  ,J=1,53-L) 
GO  TO  200 
END  IF 

I  F(  PLT( I ) . LT. 0 . 0 ) THEN 

WR I TE( 9, 300 )I,PLT( I ),(1H  , J=1 , L- 1 ) , 1H-, ( 1H  ,J=1,53-L) 
GO  TO  200 
END  IF 

WR I TE( 9, 300 ) I , PLT( I ) , ( 1 H  , J=1 , L-1 ) , 1H0, ( 1H  ,J=1,53-L) 
200  CONTINUE 

300  FORMAT! 1H  ,I5,1H  , F8 . 4, 2X, 1 H«, 60A1 ) 

WR I TE( 9, 350 ) ( 1 H*, J=1 , 54 ) 

RETURN 

END 


SUBROUTINE  TO  PLOT  BATCH  AND  PLT 


SUBROUTINE  PBATCH 

COMMON// PLT.(  2000 ) ,  NUMBAT ,  BATCH ( 2000 ) 
WR I TE( 9, 201  ) 

201  FORMAT!//////) 

YBIG=BATCH( 1 ) 

YMI N= BATCH! 1  ) 

DO  100  1=2, NUMBAT 


Cl  o  o  o 
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I F ( YM I N . LT . BAT CH (  I ) ) CO  TO  50 
YM I N=BATCH( I ) 

50  CONTINUE 

I F( YB I G. GT . BATCH( I )  )G0  TO  100 
YB I G=BATCH(  I  ) 

100  CONTINUE 

WRITE(9,350)(1H*,J=1,55) 

DO  200  1=1, NUMBAT 

IF(YBIG.EQ.YMIN)THEN 

L= I F IX(49.999#BATCH( I )  )+2 

ELSE 

L=IFIX(49.999*(BATCH( I )  -YMl N )/( YBI G-YM I N ) )+2 
END  IF 

350  F ORMAT ( 22X , 60A 1 ) 

I F ( BATCH ( I ) . GT. 0 . 0 (THEN 

WR I TE( 9, 300 ) I , BATCH ( I ) , ( 1H  , J=1 , L-1 ) , 1H+, ( 1 H  ,J=1,53-L) 

GO  TO  200 
END  I  F 

I F ( BATCH( I ) . LT . 0 . 0 (THEN 

WR I TE( 9, 300 ) I , BATCH ( I ) , ( 1H  , J=1 , L-1 ( , 1 H-, ( 1 H  ,J=1,53-L) 

GO  TO  200 
END  IF 

WR I TE( 9, 300 ) I , BATCH ( I ) , ( 1 H  , J  =  1 , L-1 ) , 1  HO, ( 1 H  ,J=1,53-L) 

200  CONTINUE 

300  FORMAT ( 1 H  ,I5,1H  , F8 . 4, 2X, 1 H*. 60A1 ) 

WR I TE( 9, 350 ) ( 1 H*, J=1 , 54 ) 

RETURN 

END 

CMtMM  SUBROUTINE  TO  CALCULATE  THE  SPECTRAL  DENSITY  Mt  tttt  Mt  tt  MM  Mt  Mt  H  H 

C MMMt  AT  ZERO  FREQUENCY  (VARIANCE)  MMMMMMMMMMMt 


SUBROUTINE  WELCH  (MID.ZERO) 

D I  MENS  I  ON  PER  I OD<  600 ) , XM( 6 ) , TEMP{ 6 ) , B( 6, 7 ) 

$, ANOVA( 16 ) , VARB( 21 ) , FJ ( 300 ) , IWK( 3200 ) , WK( 3200 ) , V(  300, 6 ) , VCV(  21 ) 
$. NBR( 6 ) , ALFA( 2 ) , IJOB(2), I ND( 1 1 ) , XYB( 6, 5 ) , A( 300, 6 ) , CHECK( 2000 ) 
COMMON// PLT( 2000 ) , NUMBAT, BATCH( 2000 ) 

COMPLEX  TRANS( 600 ) 


NUMDAT  =  NUMBAT  -  MID  +  1 
INUM  =  0 

DO  10  I  =  MID, NUMBAT 
INUM  =  INUM  +  1 
CHECK( INUM)  =  BATCH ( I  ) 

10  CONTINUE 

NHDATA  =  NUMDAT/2 
NQDATA  =  NHDATA/2 

CALL  FFTRC(CHECK, NUMDAT, TRANS, IWK.WK) 
MMM  =  NHDATA  ♦  1 
DO  15  L=2, MMM 
K  =  L  -  1 

PER  I OD( K)  =  ( CABS( TRANS( L ) )«*2 (/NUMDAT 
15  CONTINUE 

DO  30  KL=1, NQDATA 
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KK  =2*KL 
JJ  =  KK-1 

SMOTH=( ( PERIOD(JJ )+PERIOO(KK) )/2.0) 

FJ ( KL)=ALOG( SMOTH )  +  .270 
30  CONTINUE 

DO  50  1=1 , NQDATA 
A(  1.1 )  =  I 
A(  1.2)  =  1*1 
A(  1,3)  =  1**3 
A(  1,4)  =  1**4 
At  1,5)  =  1**5 
A(  1,6)  =  FJ( I  ) 

50  CONTINUE 
M  =  5 
IB  =  6 
I ND( 1 )  =  0 
I  ND(  2  )  =  0 
I  ND(  3  )  =  0 
I  ND(  4  )  =  0 
I  ND(  5  )  =  0 
I JOB( 1 )  =  0 
I J  0  B  (  2  )  =  1 
ALFA( 1 )  =  .05 
ALFA( 2 )  =  .05 
NROIM  =  300 

CALL  RLSEP( A, NQDATA, M, NRD IM, ALFA, I  JOB, I ND,  ANOVA, XYB, IB.VARB, IER) 
J  =  0 

DO  2000  1=1,5 

IF  (XYB( 1,2)  .NE.  OJTHEN 
J  =  J  +  1 

DO  2100  LL  =  1, NQDATA 
V(  LL, J  )  =  LL** I 
2100  CONTINUE 

END  IF 
2000  CONTINUE 

I F( J  .EQ.  0)THEN 

ZERO  =  EXP( XYB( 6,2)) 

RETURN 

ELSE 

J  =  J  +  1 

DO  2200  I  =  1, NQDATA 
V(I.J)  =  FJ(I) 

2200  CONTINUE 
NVAR  =  J 
NBR( 1 )  =  NVAR 
NBR( 2 )  =  NQDATA 
NBR<3)  =  NQDATA 
NBR( 4  )  =  1 
NBR( 5 )  =  1 
NBR( 6  )  =  1 

CALL  BECOVM( V, NROIM, NBR, TEMP, XM, VCV, IER) 

I  VAR  =  NVAR  -  1 
ALPHA  =0.05 

CALL  RLMUL( VCV, XM, NQDATA, I  VAR, ALPHA, ANOVA, B, I B, VARB, IER) 

UPLEFT  =  ( B( NVAR.4 )**2 )/ ANOVA ( B ) 
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AOJUST  =  ( .645*UPLEFT)/2.0 
CONE  =  EXP( -ADJUST)  .... 

ZERO  =  CONE*(  EXP(  B{  NVAR,  1 ) ) ) 


END  IF 
RETURN 
END 


APPENDIX  C 
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C  **  INTRODUCTION 


C  **  PROGRAM  TO  PERFORM  MULTIPLE  REPLICATIONS  OF 
C  **  DUOEW I CZ-DALAL  MRP  USING  INDEPENDENT  NORMALLY 
C  **  GENERATED  SAMPLES.  TEST  SAMPLES  GENERATED  ARE 
C  **  IN  A  LEAST  FAVORABLE  CONFIGURATION. 

C  **  NUMBER  OF  ALTERNAT I VE( KPOP  WITH  MAX  9)  CONSIDERED, 

C  **  INDIFFERENCE  ZONE(DSTAR),  INITIAL  SAMPLE  S IZE( NAUGHT ) , 
C  **  AND  THE  PROBABILITY  OF  CORRECT  SELECT  I ON( PCS ) 

C  **  ARE  SET  IN  INITIALIZE  BLOCK. 

C  **  DUDEW I CZ-DALAL  CRITICAL  H  VALUE  CALCULATED  BY 
C  **  SUBROUTINE  RNKSEL 


PROGRAM  AUTOH( TTY, OUTPUT, TAPE5=TTY, TAPE6=TTY, 1 APE7 . TAPE8, TAPE9 ) 
DIMENSION  DAT A( 1000 ),R(  1 000 ) , U( 20 ) , S I GMA( 20 ) , IT0TAL(20) 

DOUBLE  PRECISION  DSEED, ODSEED 

c initialize  variables  mMHmmmtmmm 

NAUGHT  =  7 
NMAX  =  0 
NDATA  =100 
DELTA  =  7 
PCS  =  .90 
KPOP  =  6 


C  **  THE  MEAN  AND  STANOARO  DEVIATION  OF  THE  TEST 
C  **  ALTERNATIVES  ARE  SET  BELOW 


U(1)  =  53 
U(  2  )  =  60 
U(3)  =  53 
U{4)  =  53 
U ( 5 )  =  53. 

0(6)  =  53. 

0(7)  =  53. 

U( 8 )  =  53 
0(9)  =  53. 

S I GMA( 1 )  =  4.5 
S I GMA( 2 )  =  4.0 
S I GMA ( 3 )  =  5.5 
SIGMA(4 )  =  2.8 
S IGMA( 5  )  =  6.8 
S I GMA( 6 )  =  10.3 
SIGMA(7)  =  3.4 
SI GMA( 8 )  =  9.5 
SIGMA(9)  =  8.6 
DSEED  =  9841337.00 
ODSEED  =  DSEED 


KPASS  =  1 

C CALL  SUBROUTINE  TO  CALCULATE  ############/!'### 
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Ctttttttttt  DUDEWICZ  AND  DALAL  H  VALUE  ( DNDH )  tttttttttttttttttttttt 

C 

C 

CALL  RNKS£L( NAUGHT, KPOP, PCS.ONDH) 

WR I TE( 9, * ) ' DNDH  = ' , DNDH 
C 

ctttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttt 

c tttttttttt  INITIALIZE  VARIABLES  USED  tttt U tttttt tt tt tt tttt tt tttttt tt tt tt tt 
Ctttttttttt  DURING  EACH  REP  I  CAT  I  ON  tttttttttttttttttttttttttttttttttttttt 
C 
C 

1  BEST  =  0.0 
KOUNT  =  7 
2  TSUM  =  0.0 

DIFSQ  =  0.0 
EXSUM  =0.0 

ctttttttttt/tttttttHtttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttt 

Ctttttttttttt  GENERATE  DATA  — NORMAT  VARIATE  WITH  MEAN  =  U  tttttttttttttttt 
ctttttttttttt  and  so  =  sigma 

C 

C 

CALL  GGNML( OSEED, NDATA, R ) 

DO  5  J=1, NDATA 

DATA(J)  =  (R(J)*SIGMA( KOUNT) )  +  U(KOUNT) 

5  CONTINUE 
C 
C 

mmmmmmmmmmmtimmmmiimmmmmM 

c 

c 

ctttt/ft/ttm/fitf/ttmmf/MttftMttt/t/ttmtfmttmitMtimMmt/ 

C  tttttttttt  CALCULATE  SAMPLE  MEAN  ANO  tttttttttttttttttttttttttttttttttttt 
Ctttttttttt  VARIANCE  BASED  ON  INITIAL  tttttttttt tttt tttttttttt tttttttttt tt 
Ctttttttttt  SAMPLE  SIZE  (NAUGHT)  tttttttttttttttttttttttttttttttttttt 

C 

DO  10  1=1, NAUGHT 

TSUM  a  TSUM  +  DATA( I ) 

10  CONTINUE 

AVG  =  TSUM/NAUGHT 
DO  15  1=1, NAUGHT 

DIFSQ  =  DIFSQ  +  ( ( DATA( I )-AVG)**2 ) 

15  CONTINUE 

VAR  =  D I FSQ/( NAUGHT- 1 ) 

C 

Ctttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttttt 
Ctttttttttt  DETERMINE  IF  LARGER  SAMPLE  SIZE  (NEXTRA)  Htttt 
Ctttttttttt  IS  NEEDEO  BASED  ON  OUDEWICZ,  RAMBERG,  AND  tttttt 
Ctttttttttt  CHEN  PROCEDURE.  NEXTRA  .GT.  NAUGHT  tttttt 

C 
C 

IDDOBS=( ( VAR*(DNDH**2) )/(DELTA**2) )+. 999999 
I  PLUS  =  NAUGHT  +  1 
IF  (KPOP  .GT.  2JTHEN 

NEXTRA  =  MAX0( I  PLUS, IDDOBS) 
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C  **  IF  REQUIRED  SAMPLE  SIZE(NEXTRA)  IS  GREATER 
C  **  THAN  DATA  AVA I LABLE— RETURN  AND  GENERATE  MORE 

I F ( NEXTRA  .CT.  NDATAJTHEN 

WR I TE( 9 , * ) ' MORE  DATA  NEEDED' 

WR I TE( 9, * ) ' NEXTRA  =', NEXTRA 
NDATA=NEXTRA 
GO  TO  2 
ENO  IF 
C 

C0000000000000000000000000000000000000000000000000 
C00000  USING  THE  SAME  PROCEDURE  DETERMINE  0000 

C 00000  WEIGHTING  FACTORS  (WEIGHT)  WHICH  0000 

C 00000  IS  USED  TO  CALCULATE  THE  SPECIAL  0000 

C 00000  SAMPLE  MEAN  USED  FOR  BETWEEN  0000 

C 00000  POPULATION  COMPARISONS  (COMPARE)  0000 

C 
C 

DO  20  1  =  1  PLUS, NEXTRA 

EXSUM  =  EXSUM  +  DATA( I ) 

20  CONTINUE 

EXAVG  =  EXSUM/( NEXTRA- I PLUS+1 ) 

TOP  =  ( ( NEXTRA-NAUGHT )*( DELTA**2 ) ) 

BOTTOM  =  (DNDH**2)*VAR 

COR  =  FLOAT(NEXTRA)/FLOAT( NAUGHT) 

REC  = I.O/COR 
TIM  =  TOP/BOTTOM 
BRAC  =  1.0-TIM 
SUB  =  COR*BRAC 
SQ  =  1.0  -  SUB 
ALMOST  =  1.0  +  SQRT(SQ) 

WEIGHT  =  REC* ALMOST 

COMPARE  =  ( WE  I GHT*AVG )+( ( 1 . O-WE IGHT )*EXAVG ) 
GO  TO  22 
ELSE 
C 

C0000000000000000000000000000000000000000000000000 
C00000  THIS  SECTION  IS  USED  IF  COMPARING  00000 
C00000  ONLY  2  ALTERNATIVES.  NO  WEIGHTING  00000 

C00000  FACTORS  NEEDED  00000 

C 
C 

NEXTRA  =  MAXO( NAUGHT, I ODOBS) 

I F( NEXTRA  .GT.  NDATAJTHEN 

WR I TE( 9, * ) 1  MORE  DATA  NEEDED' 

WRITE(9,*)' NEXTRA  =', NEXTRA 
NDATA=NDATA+100 
GO  TO  2 

END  IF 

I F( NEXTRA  .EQ.  NAUGHT (THEN 
COMPARE  =  AVG 
GO  TO  22 
END  IF 

DO  21  1=1  PLUS, NEXTRA 


A 
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TSUM  =  TSUM  +  DATA( I ) 

21  CONTINUE 
COMPARE  =  TSUM/NEXTRA 

C 

C#####  END  K  =  2  SECTION  ###################### 

C ################################################# 

END  IF 
C 
C 

C ################################################# 

C#####  WHICH  POPULATION  HAS  THE  ############ 

C#####  LARGEST  ’COMPARE'  VALUE  AND  ############ 

C#####  PRINT  SUMMARY  RESULTS  ############ 

i  C 

22  I F( COMPARE  .GT.  BEST) THEN 

BEST  =  COMPARE 
NUMBER  =  KOUNT 

[  END  IF 

I F( KOUNT  .LT.  KPOPJTHEN 

i  DSEED  =  DSEED*3 . DO 

f  KOUNT  =  KOUNT  +  1 

I F ( NEXTRA  .GT.  NMAXJTHEN 
NMAX  =  NEXTRA 
END  I  F 

J  GO  TO  2 

END  I  F 

I TOTAL( NUMBER )= I TOTAL( NUMBER)  +  1 
i  I F( KPASS  .LT.  100JTHEN 

!  KPASS  =  KPASS  +  1 

!  CO  TO  1 

i  END  I F 

DO  30  K  =  1.KP0P 

WRITE! 9, 100) K. ITOTAL(K),U|K),SIGMA(K) 

100  F0RMAT(//,6X, 'ALTERNATIVE' , 14, '  HAS', 14,'  BEST  RESULTS ' , 

$/, 6X, ' THE  TRUE  MEAN  IS'.F8.2,'  WITH  A  STANDARD  DEVIATION  0F',F8.2) 
30  CONTINUE 

WR I T E (  9 ,  1 1 0 ) PCS , ODSE ED , DE LT A , NAUGHT . DNDH , NMAX 
110  FORMAT ( III, 6X, ' FOR  THIS  TEST:  PCS  =',F4.3’  DSEED  =’, 

$D16. 8, '  DELTA  =' , F5.2./.6X, '  NAUGHT  = ' , 1 4, ’  DNDH=',F5.3, 

$'  NMAX  =' , 15) 

STOP 

END 


C  **  SUBROUTINE  TO  AUTOMATICALLY  GENERATE  THE  CRITICAL  H  VALUE 
C  **  USED  TO  DETERMINE  THE  REQUIRED  SIMULATION  RUN  LENGTH 


SUBROUTINE  RNKSEL( NO, K, PSTAR, H) 
COMMON/RSTOL/TOLF, HTOLF , NS  I  CD, AERR, RERR, ITMAX 
COMMON/RSCON/ P I , TOLZ , B I GM 
TOLF  =  1.E-6 
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AERR  =  1 . E-8 
NS  I  CD  =  5 
RERR  =  1.E-B 
ITMAX  =  500 
PI  =  3.1415926535 
TOLZ  =  1 . E-20 
B I GM=  1 . E20 

H  =  H0( NO, K, PSTAR,  I  FAULT ) 

RETURN 

END 

FUNCTION  H0( NNO, KK, PPSTAR,  I  FAULT) 

EXTERNAL  GFUNC 

COMMON/RSTOL/TOLF, HTOLF, NS  I  GO, AERR, RERR,  ITMAX 
COMMON/ RSCON/ P I ,TOLZ,BIGM 

COMMON/RSTOST/NO, DF, K, KM1 , CNORM, XPNT , A, B, PSTAR, HTEMP 
DIMENSION  WK( 30 ) , PAR( 1 ) , H( 1  ) 

DATA  NDIM/1/ 

NO  =  NNO 
K  =  KK 

PSTAR  =  PPSTAR 

HO  =  -BIGM 

I  FAULT  =  0 

DF  =  NO  -  1 

KM1  =  K  -  1 

XPNT  =  (DF  +  1.0J/2.0 

CNORM  =  GAMMA( XPNT)/ (  GAMMA( 0 . 5*DF )*SQRT( P I *DF )  ) 

HTOLF  =  TOLF/2.0 

CALL  MDST I ( HTOLF, DF, B, I ER ) 

IF  ( I ER  .NE.  0)  THEN 
I  FAULT  =  I ER  +  1000 
RETURN 
END  IF 
A  =  -B 
H ( 1 )  *  0.0 

CALL  ZSCNT ( GFUNC, NS  I  CD, ND I M, ITMAX, PAR, H, FNORM.WK,  I ER) 
HO  =  H(1) 

IF  ( I ER  .NE.  0)  THEN 

I  FAULT  =  2000  ♦  I  ER 

END  IF 

RETURN 

END 

SUBROUTINE  GFUNC( H, G, ND IM, PAR ) 

DIMENSION  H(NDIM),G(NDIM), PAR( 1 ) 

COMMON/RSTOL/TOLF, HTOLF, NS IGD, AERR, RERR, ITMAX 
COMMON/RSCON/ P I , TOLZ , B I  CM 

COMMON/RSTDST/NO, DF, K, KM1 , CNORM, XPNT , A, B, PSTAR, HTEMP 
EXTERNAL  SUMMND 
HTEMP  =  H( 1 ) 

GTEMP  =  DCADRE( SUMMND, A, B, AERR, RERR, ERROR, I ER) 

IF  ( IER.CE.100)  THEN 
I  FAULT  =  3000  +  I ER 
WRITE  (9,100)  I  FAULT 

100  FORMAT  ('  ***ERROR  IN  DCADRE  =  ',14,'  ***' ) 

STOP 
END  IF 
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100 


G( 1 )  =  GTEMP  -  PSTAR 

RETURN 

END 

FUNCTION  SUMMND(T) 

COMMON/ RSTOL/TOLF, HTOLF, NSIGD, AERR, RERR, I TMAX 
COMMON/RSCON/PI , TOLZ, B I  CM 

COMMON/RSTDST/NO, OF, K, KM1 , CNORM, XPNT, A, B, PSTAR, HTEMP 
FI  =  CNORM* (  (1.0  +  T*T/DF )**( -XPNT )  ) 

X  =  T  +  HTEMP 

CALL  MDTD(  ABS(X),  DF,  TAILS,  IER) 

IF  (IER  .GT.  0)  THEN 
I  FAULT  =  4000  +  IER 
WRITE  (9,100)  I  FAULT 

FORMAT  ('  ***ERROR  IN  MOTD  =  ',14,’  ***'  ) 

END  IF 

F2  =  0.5  ♦  S IGN( 0. 5, X)*{ 1 . 0  -  TAILS) 

SUMMND  =  F1*(  F2**KM1  ) 

RETURN 

END 


APPENDIX  D 
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C  **  INTRODUCTION 

C  **  THE  SPECTRAL  METHOD  OEVELOPED  BY  HE  I DELBERGER  AND  WELCH 
C  **  IS  USED  TO  ESTIMATE  THE  VARIANCE  OF  THE  SAMPLE  MEAN 
C  **  PROCEDURE  USES  THE  ESTIMATE  OF  THE  SPECTRUM 
C  **  AT  ZERO  FREQUENCY 

PROGRAM  WELCH( TTY, OUTPUT, TAPE5=TTY,TAPE6=TTY,TAPE7,TAPE8, TAPE9 ) 
D I  MENS  I  ON  DATA( 1000 ) ,  R( 500 ) , PER  1 0D( 500 ) , XM( 6 ) , TEMP( 6 ) . B( 6 , 7 ) 

$, AN0VA( 16 ) , VARB( 21 ) , FJ ( 500 ) , I WK( 300 ) , WK( 300 ) , V( 1000, 6 ) , VCV( 21 ) 
$, NBR( 6  ) ,  ALFA( 2 ) ,  IJ0B(2),  I ND(  1 1 ) , XYB( 6, 5 ) , A(  1000,6) 

DOUBLE  PRECISION  DSEED, P{ 500) 

COMPLEX  TRANSf  500 ) 

DSEED  =  2003. DO 
TOALV  =0.0 
TOTALZ  =0.0 
KOUNT  =  0 

C  **  DO  25  REPLICATIONS  OF  TEST  USING  100  DATA  POINTS 

NREP  =  25 
100  NDATA  =  100 

KOUNT  =  KOUNT  +  1 
U  =  50.0 
SD  =  30. 

NHDATA  =  NDATA/2 

NQDATA  =  NHDATA/2 

WR I TE(  9, * ) ' DSEED  ='.DSEED 

WRITE(9,*)'NQDATA  =  \ NQDATA 

C  **  USE  IMSL  ROUTINE  TO  GENERATE  NORMAL  (0,1)  VARIATES 
CALL  GGNML( DSEED, NDATA, R) 

C  **  GENERATE  TEST  SAMPLE  WITH  MEAN  OF  U  AND  STANDARD 
C  **  DEVIATION  OF  SD 

DO  5  J=1, NDATA 

DATA(J)  =  (R(J)*SD  «•  U) 

5  CONTINUE 
TSUM  =  0.0 
VSUM  =0.0 

C  **  CALCULATE  THE  VARIANCE  OF  THE  TEST  SAMPLE  USING  THE 
C  **  CLASSICAL  METHOD 

DO  10  1=1, NDATA 

TSUM  =  TSUM  ♦  DATA) I ) 

10  CONTINUE 

AVG  =  TSUM/ NDATA 
DO  20  1=1, NDATA 

VSUM  =  VSUM  +  ( (DATA( I )-AVG)**2) 

20  CONTINUE 
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CLASSV  =  VSUM/( NDATA-1 ) 


C  **  USE  IMSL  ROUTINE  FFTRC  TO  COMPUTE  THE  COMPLEX 
C  **  CONJUGATE  OF  THE  FAST  FOURIER  TRANSFORM 

CALL  FFTRC( DATA, NDATA, TRANS, IWK.WK) 

MMM  =  NHDATA  +  1 
CO  15  L=2, MMM 
K  =  L  -  1 

C  **  COMPUTE  PER  I ODOGRAM  FROM  FAST  FOURIER  TRANSFORM  OF 
C  **  OATA  (TRANS) 


PER  I OD( K )  =  ( CABS( TRANS( L) )**2 ) /NDATA 
15  CONTINUE 

DO  30  KL=1 , NQDATA 
KK  =2*KL 
JJ  =  KK-1 


C  **  STABILIZE  THE  VARIANCE  OF  PER  I ODOGRAM  BY  AVERAGING 
C  **  OVER  ADJACENT  VALUES  AND  TAKING  NATURAL  LOG 

SMOTH= ( ( PER  1 0D( JJ  J+PER 1 0D( KK) )/2, 0 ) 

FJ( KL )=ALOG( SMOTH )  ♦  .270 
30  CONTINUE 

DO  50  1=1, NQDATA 
A( 1 . 1  )  =  I 
A( 1,2)  =  1*1 

A( 1,3)  =  1**3 
A( 1,4)  =  1**4 
A(  1,5)  =  1**5 
A(  1.6)  =  FJ(  I  ) 

50  CONTINUE 
M  =  5 
IB  =  6 
I  ND(  1  )  =  0 
I  NO ( 2 )  =  0 
I  ND(  3  )  =  0 
I  ND(  4 )  =  0 
I  ND(  5 )  =  0 
IJOB(I)  =  0 
I JOB( 2 )  =  1 
ALFA( 1 )  =  .05 
ALFA( 2 )  =  .05 
NRDIM  =  1000 


C  **  IMSL  ROUTINE  TO  DO  FORWARD  STEPWISE  REGRESSION  OF 
C  **  DATA.  USED  TO  SEE  WHICH  VARIABLES  ARE  IN  MODEL 

CALL  RLSEPI A, NQOATA.M, NRDIM, ALFA, IJOB, I ND, ANOVA, XYB, IB.VARB, IER) 
WRITE(9,*)'RLSEP  IER  =',IER 
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55 


2100 

2000 


2200 


C  ** 
C  ** 


C  ** 
C  ** 
C  ** 
C  ** 
C  ** 


60 


WR I TE( 9, * ) ' RSQR  FOR  RLSEP  FIT* , ANOVA( 1 1 ) 
WRITE(9,*) 'RLSEP  RESULTS’ 

DO  55  1=1,6 

WR  I  TE(  9,  *  )  I ,  XYB(  1,2) 

CONTINUE 
J  =  0 

DO  2000  1=1,5 

IF  ( XYB(  1,2)  .NE.  0  )THEN 
J  =  J  +  1 

DO  2100  LL  =  1 , NQDATA 
V( LL, J )  =  LL**I 
CONTINUE 
END  IF 
CONTINUE 
I  F ( J  .EQ.  0 (THEN 

ZERO  =  EXP(  XVB(  6, 2 )  ) 

WR I TE( 9, * ) ' PERI ODOGRAM  IS  A  CONSTANT' 

WR I TE( 9, * ) ' U  =' ,U, 'SO  =' ,SD 

WR I TE( 9, * ) 1  SPECTRUM  AT  ZERO  FREQ  =',ZERO 
GO  TO  200 
END  IF 
J  =  J  +  1 

DO  2200  I  =  1, NQDATA 
V<  I ,  J )  =  FJ(  I  ) 

CONTINUE 
NVAR  =  J 
NBR( 1 )  =  NVAR 
NBR( 2 )  =  NQDATA 
NBR( 3 )  =  NQDATA 
NBR( 4 )  =  1 
NBR( 5 )  =  1 
NBR( 6 )  =  1 

IMSL  ROUTINE  TO  PERFORM  REQUIRED  PRECONDITIONING 
OF  DATA  PRIOR  TO  USING  RLMUL 

CALL  BECOVM( V, NRD I M, NBR. TEMP, XM, VCV, IER) 

WR I TE( 9, * ) 1 BECOVM  IER  =’ , IER 
I  VAR  =  NVAR  -  1 
ALPHA  =0.05 


IMSL  ROUTINE  FOR  STANDARD  MULTIPLE  LINEAR  REGRESSION 
SUPPLIES  AS  OUTPUTS  THE  VALUES  OF  RESIDUAL  MEAN 
SQUARE  AND  THE  ESTIMATED  STANDARD  ERROR  OF 
THE  INTERCEPT.  REQUIRED  TO  CALCULATE  THE  UPPER 
LEFT  ELEMENT  OF  (X'X)-I  MATRIX 

CALL  RLMUL( VCV, XM, NQOATA, I  VAR, ALPHA, ANOVA, B, IB,VARB, IER) 
DO  60  I  =  1 , NVAR 

WRITE(9,*) 'RLMUL  COEFF’ , I , '  =  ’ . B( 1,1) 

CONTINUE 

WR I TE( 9, * ) 1  BOSE  =  ' , B( NVAR , 4 ) , ' AN0VA8  =  ’,AN0VA(8) 

UPLEFT  =  ( B( NVAR, 4 )**2 )/ANOVA( 8 ) 

WR I TE( 9, * ) ' AN0VA1 1  =',AN0VA(11) 
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WR I T£( 9, * ) ' U  = ' , U, ' SD  =',SD 
WR  I  TE(  9,  * ) ' UPLEFT  =  UPLEFT 
ADJUST  =  ( .6U5*UPLEFT)/2.0 
CONE  =  EXP( -ADJUST) 

ZERO  =  CONE*( EXP( B( NVAR, 1 ) ) ) 

WRITE! 9,* (UPLEFT, CONE, ZERO 
200  WR I T  E ( 9 , * ) 1 CLASSV  DURING  KOUNT' , CLASSV, KOUNT 


C  **  AVERACE  THE  MEASURED  VARIANCE  BY  CLASSICAL  AND  SPECTRAL 
C  **  METHOD  OVER  THE  25  RUNS  AND  PRINT  RESULTS 

TOTALV  =  TOTALV  ♦  CLASSV 
TOTALZ  =  TOTALZ  ♦  ZERO 
IF  (KOUNT  .LT.  NREP )G0  TO  100 
AVGSD  =  TOTALV/NREP 
AVGZ  =  TOTALZ/NREP 

WR I T  E ( 9 , * ) ' AVCS0= ' , AVGSD , ' AVGZ= ' , AVGZ 

STOP 

END 


APPENDIX  E 
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C  **  THIS  PROGRAM  IS  A  SLAM  SIMULATION  USED  TO  MODEL  A  SERIAL 
C  **  QUEUE  REPAIR  FACILITY.  THE  NUMBER  OF  REPAIR  STATIONS 
C  **  IS  SET  BY  THE  VARIABLE  NSTA.  THE  ARRIVAL  RATE  AND 
C  **  SERVICE  RATE  ARE  SET  BY  ARIVAL  AND  SERVIC  RESPECTIVELY 

C  **  THE  STEADY  STATE  PERFORMANCE  MEASURE  FOR  COMPARING 
C  **  THE  ALTERNATIVE  CONFIGURATIONS  IS  CALCULATED  BY  THE 
C  **  INTEGRATED  MULTIPLE  RANKING  PROCEDURE  DEVELOPED  BY 
C  **  J  WILSON  AND  T  DICKINSON  AT  THE  UNIVERSITY  OF  TEXAS 


C  **  THE  CODE  WRITTEN  STARTING  AT  SUBROUTINE  NQUE  MY  BE  LIFTED 
C  **  AND  USED  AS  A  MULTIPLE  RANKING  PROCEDURE  FOR  ANY  DISCRETE 
C  **  EVENT  SIMULATION  WRITTEN  USING  SLAM 

C  **  IT  IS  POSSIBLE  WITH  MINOR  MODIFICATION  TO  USE  THIS  PROCEDURE 
C  **  ON  A  SIMULAION  UTILIZING  ANOTHER  LANGUAGE 


PROGRAM  MA I N( I NPUT, OUTPUT, TAPE5= INPUT, TAPE6=OUTPUT, TAPE7, TAPE8 ) 
COMMON  QSET ( 5000 ) 

COMMON/ SCOM 1 /  ATRIB( 100), DD( 100),DDL( 100),DTNOW, I  I , MFA, MSTOP, NCLNR 

1 ,  NCRDR,  NPRNT,  NNRUN,  NNSET ,  NTAPE ,  SS(  100  ) ,  SSi_(  1 00  ) ,  TNEXT ,  TNOW,  XX (  100) 

2,  AR I VAL, SERVIC, NSTRM, KOUNT, N, NS IZE, ALPHA, NSTA, KKK, LENROW,  NREP,  I  EXP 
C 

NNSET  =  5000 
NCRDR  =  5 
NPRNT  =  6 
NTAPE  =  7 
NSTRM  =  3 
KOUNT  =  0 
ARIVAL  =  2.0 
SERVIC  =1.0 
LENROW  =  100 
NREP  =  16 
NS IZE  =  1 
ALPHA  =  .1 
NSTA  =  1 
CALL  SLAM 
STOP 
END 


C  **  SLAM  SUBROUTINE  TO  SET  I N I TAL  CONDITIONS  FOR  THE  SIMULATION 


SUBROUTINE  INTLC 

COMMON / SCOM 1 /  ATR I B( 1 00 ) , DD( 100 ) , DDL( 1 00 ) , DTNOW, I  I , MFA, MSTOP, NCLNR 

1 ,  NCRDR, NPRNT, NNRUN, NNSET, NTAPE, SS( 100 ) , SSL( 100 ) , TNEXT, TNOW, XX( 100 ) 

2,  ARIVAL, SERVIC, NSTRM, KOUNT, N, NSIZE, ALPHA, NSTA, KKK, LENROW, NREP, I  EXP 
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r 

t 


c 

0###* 

c 

c 


SET  UP  INITIAL  CONDITIONS  FOR  MODEL 
TELLER  STATUS 


5 

C 

C 

C 

C#*** 


c 

0#**# 

c 


DO  5  1=1 , NSTA 
XX( I  )  =  0.0 
CONTINUE 


INITIALIZE  KKK  FOR  EACH  RUN 
KKK  =  0 
N  =  1 

I F(MOD( NNRUN, 16 )  .NE.  0  JTHEN 
IMUL  =  NNRUN/1 6 
I  EXP  =  IMUL  +  1 
KOUNT  =  NNRUN  -  (IMUL*16) 

ELSE 

KOUNT  =  16 
I  EXP  =  NNRUN/16 
END  IF 

I F  (KOUNT  . EQ. 1 )THEN 

WR I T  E ( 6 , * ) '  EXPERIMENT  NUMBER  =’,IEXP 
END  IF 

SET  UP  ATTRIBUTES  OF  FIRST  ARRIVINC  XACT 
TNA  =  EXPON( AR I VAL, NSTRM ) 


ARRIVAL  TIME 

ATR I B( 1 )  =  TNOW  *  TNA 

SERVICE  TIME 

ATR I B( 2 )  =  EXPON(SERVIC, NSTRM) 


C 

0**** 

C 

c 

c 

c 

c 

0*#** 

c 


SERIAL  NUMBER 
ATR I B( 3 )  =  N 

SHOW  NEXT  SERVICE  FACILITY  TO  VISIT 


ATRIB(4)  =  1 


C 

0#*** 

C 


POST  ENTRY  ON  EVENT  CALENDAR  WITH  EVENT  CODE  =  1,  DELAY  =  TNA 

CALL  SCHDL( 1 , TNA, ATR 1 8 ) 

RETURN 

ENO 

SUBROUTINE  EVENT (I CODE) 

INVOKE  APPROPRIATE  EVENT  PROCESSING  ROUTINE 


1. 1. 
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GO  TO  (10,20,30), ICODE 
C 

C  ARRIVAL  EVENT 

10  CALL  ARVL 
RETURN 
C 

C  END  OF  SERVICE  EVENT 

20  CALL  ENDSV 
RETURN 
C 
C 

C  DATA  EVENT 

30  CALL  NQUE 
RETURN 
END 
C 


C  **  SLAM  SUBROUTINE  TO  SCHEDULE  ARRIVALS  TO  NEXT  WORK  STATION 
C  **  INCLUDES  SCHEDULING  NEW  ARRIVALS  TO  THE  SYSTEM 


C 

SUBROUTINE  ARVL 

COMMON/ SCOM 1 /  ATR I B( 100), DD( 100),DDL( 100),DTNOW,  I  I , MFA, MSTOP, NCLNR 

1 ,  NCRDR, NPRNT, NNRUN, NNSET, NTAPE, SS( 100),SSL( 100 ) , TNEXT, TNOW, XX( 100) 

2,  AR I VAL, SERV 1C, NSTRM, KOUNT, N, NS IZE, ALPHA, NSTA, KKK, LENROW, NREP, I  EXP 
DIMENSION  BUFFR( 7 ) 

C 

c**«*  GENERATE  THE  NEXT  ARRIVAL  BEFORE  PROCESSING  THE  CURRENT  XACT 
C 

IF  ( ATR 18(4)  .GT.  1)  GO  TO  5 
TNA  =  EXPON( AR I VAL, NSTRM ) 

BUFFR(I)  =  TNOW  +  TNA 

BUFFR( 2 )  =  EXPON(SERVIC, NSTRM) 

N  =  N  +  1 

BUFFR( 3 )  =  N 

BUFFR( 4 )  =  1 

CALL  SCHDL( 1 , TNA, BUFFR ) 

C 

C***#  DETERMINE  DISPOSITION  OF  CURRENT  ARRIVAL 
C 

5  MMM  =  ATR I B( 4 ) 

C 

C  CHECK  SERVER  STATUS 

IF  (XX(MMM).EQ.I.O)  GO  TO  10 
C 

C  IF  IDLE,  GO  INTO  SERVICE 

XX( MMM )  a  1 . 0 
SVCTIM  =  ATR I B( 2 ) 

C 

C  POST  ENTRY  ON  EVENT  CALENDAR  WITH  EVENT  CODE  =  2,  DELAY  =  SVCTIM 
CALL  SCHDL( 2, SVCT IM, ATRIB) 

RETURN 
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r 


c 

C  IF  TELLER  IS  BUSY,  GO  INTO  QUEUE 
10  CALL  F I LEM( MMM, ATR I B ) 

RETURN 

ENO 


C  **  SUBROUTINE  TO  PROCESS  CUSTOMERS  AS  THEY  FINISH  SERVICE  AT 
C  **  WORK  STATION.  IF  STATION  IS  LAST,  CALL  SUBROUT  I NE( NQUE)  TO 
C  **  COLLECT  NECESSARY  DATA 


SUBROUTINE  ENDSV 

COMMON/SCOMV  ATR I B( 100) , DD| 100 ), DDL( 100), DTNOW, I  I , MFA, MSTOP, NCLNR 

1 ,  NCROR , NPRNT , NNRUN, NNSET, NTAPE, SS( 100 ) , SSL( 100 ) , TNEXT, TNOW, XX( 100) 

2,  AR I VAL, SERVIC, NSTRM, KOUNT, N, NS  I ZE, ALPHA, NSTA, KKK, LENROW, NREP, I  EXP 
DIMENSION  BUFFR( 7 ) 

C 

C#***  PROCESS  DEPARTING  CUSTOMER 
C 

JJ  =  ATRI B( 4 ) 

IF  (ATR I B(4 )  .GE.  NSTA)  GO  TO  20 

ATRIB(4 |  =  ATR I B( 4 )  +  1 

ATR I B( 2 )  =  EXPON(SERVIC, NSTRM) 

CALL  SCHDL( 1,0., ATRI B) 

GO  TO  30 

20  ATRI B( 5 )  =  TNOW  -  ATRIB(I) 

CALL  5CHDL( 3,0., ATR I B ) 

C 

c#***  DETERMINE  DISPOSITION  OF  SERVER 
C 

C  CHECK  THE  QUEUE 

30  IF  (NNQ(JJ)  .EQ.  0)  GO  TO  10 
C 

C  IF  NONEMPTY,  REMOVE  FIRST  XACT  FROM  FILE  JJ  &  PUT  INTO  SERVICE 
CALL  RMOVE( 1 , JJ , BUFFR) 

SVCTIM  =  BUFFR( 2 ) 

C 

C  POST  ENTRY  ON  EVENT  CALENDAR  WITH  EVENT  CODE  =  2,  DELAY  a  SVCTIM 
CALL  SCHDL(2, SVCTIM, BUFFR) 

RETURN 

C 

C  IF  QUEUE  IS  EMPTY,  CHANGE  TELLER  STATUS 
10  XX(JJ)  =  0.0 
RETURN 
END 
C 
C 
C 


C  **  SUBROUTINE  TO  COLLECT  DATA  AND  CALL  APPROPRIATE  SUBROUTINE 


ooo 
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C  **  WHEN  INITIAL  SIMULATION  RUNS  ARE  COMPLETE— CALLS  SUBROUTINES 
C  **  TO  INDUCE  NORMAL  I TY( W I LK ) ,  DETECT  AND  TRUNCATE  INITIAL  BIAS 
C  **  { I BSUB) ,  AND  CALCULATE  REQUIRED  SIMULATION  RUN  LENGTH( MRPSUB ) 

C  **  BASED  ON  THIS  RUN  LENGTH  THE  ROUTINE  CALCULATES 
C  **  STATISTIC  (COMPARE)  USED  TO  RANK  ALTERNATIVES 


SUBROUTINE  NQUE 

COMMON / SCOM 1 /  ATR I B( 1 00 ) , DD( 1 00 ) , DDL( 100),DTNOW, t I , MFA, MSTOP, NCLNR 

1 ,  NCRDR, NPRNT, NNRUN , NNSET, NTAPE, SS( 100),SSL( TOO), TNEXT , TNOW, XX( 100 ) 

2,  AR I VAL, SERV I C , NSTRM, KOUNT, N , NS  I ZE , ALPHA, NSTA, KKK, LENROW, NREP, I  EXP 
DIMENSION  BUFFR( 7 ) , ADD( 30000 ), DATA( 16, 100 ), BATCH( 10000) 

$, DNORMAL( 5000 ) , ARRAYC( 100) 


kuk  —  kkk  +  1 

IF  (  I  FAULT  .EQ.  50)  GO  TO  1990 


I F ( KKK  .CT.  LENROW )G0  TO  7 

IBDATA  =  LENROW 

DATA( KOUNT, KKK)  =  -ATR I B( 5 ) 

I F( KOUNT. EQ. NREP. AND. KKK. EQ. LENROW) THEN 
LLL  =  0 

CALL  SWSUB( DATA, NREP, NS IZE, I  FAULT ) 


IF  ( NS IZE  .CT.  3  .ANO.  I  FAULT  . NE.  TO ) THEN 

WR I T E ( 6 , * ) 1  PASSED  SW  TEST  BUT  NSIZE  TOO  BIG’ 

NS IZE  =  3 
END  IF 

IF  ( I  FAULT  .EQ.  10JTHEN 

WR I T E ( 6 , * ) '  PROBLEMS  NSIZE  TOO  BIG' 

WR I TE( 6,*)' CONTINUE  WITH  NSIZE  =  3' 

NSIZE  =  3 
ENO  IF 

DO  1970  1=1, LENROW 

DNORMAL(  I )  =  DATA( KOUNT, I  ) 

1970  CONTINUE 

CALL  I BSUB( DNORMAL, NSIZE, LENROW, ALPHA, ITRUNC, I  FAULT 
$, BATCH, NUMBAT) 

1980  JUNK  =  ITRUNC*NSIZE 

IF  ( I  FAULT  . EQ, 50 )  THEN 

WR I TE( 6, *) 1  TOO  MUCH  TRUNCATION' 

RETURN 

1990  LLL  =  LLL  +  1 

IBEX  =  LENROW  +  LLL 
DNORMAL! IBEX)  =  -ATRI B( 5 ) 

I  BOAT A  =  ( 2 . 5*JUNK) 

IF  (IBEX  .LT.  IBDATA) RETURN 
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2000 


2010 

1234 

7 

C 

C 


c 


15 

C 


CALL  IBSUB  ( DNORMAL, NSIZE, IBOATA, ALPHA, ITRUNC 
,  I  FAULT, BATCH, NUMBAT) 

CO  TO  1980 
END  IF 

WR I TE( 6, 2000 )ALPHA, I BDATA, JUNK, NSIZE, NUMBAT 
FORMAT (//,7X, 'BASED  ON  TYPE  I  ERROR  OF',F6.3, 

'  THE  ORIGINAL' , 16, '  DATA  POINTS  MUST  ',/,7X, 

'HAVE', 14,'  DATA  POINTS  TRUNCATED  TO  ELIMINATE  IB' 
,/,7X, 'USING  A  BATCH  SIZE  OF', 14,’  THERE  ARE’,/, 

,16,'  USEABLE  BATCHED  DATA  POINTS  FOR  FURTHER  TESTING') 


CALL  MRPSUB  ( NUMBAT, BATCH, NEXTRA, I  FAULT ) 


IF  (  I  FAULT  .EQ.  100)  THEN 
WR I T  E ( 6 , * ) '  ' 

END  IF 

IF  (NEXTRA  .EQ.  NUMBAT)  THEN 
TSUM  =0.0 
DO  2010  1=1, NUMBAT 

TSUM  =  TSUM  +  BATCH ( I ) 

CONTINUE 

COMPARE  =  TSUM/NUMBAT 

WR I TE( 6, * ) '  FINAL  COMPARE  VALUE  =', COMPARE 
WR I TE( 6, 1234 ) 

FORMAT!////) 

GO  TO  30 
END  IF 

I F ( KKK  .EQ.  IBDATAJRETURN 
ADD(KKK)  =  -ATR I B( 5 ) 

JJJ  =  (NEXTRA  -  NUMBAT )*NS IZE  +  I BDATA 
IF  (JJJ  .GT.  N SAMPLE )NSAMPLE  =  JJJ 
I F( KKK  .LT.  JJJ )RETURN 


IBEGIN  =  I BDATA  +  1 
I  FIN  =  I BDATA  +  NSIZE 
NDIF  =  NEXTRA  -  NUM8AT 
111=  NUMBAT 

DO  10  1=1, NDIF 
TOTAL  =0.0 
DO  15  J= I  BEG  IN, IFIN 
TOTAL  =  TOTAL  ♦  ADD(J) 
CONTINUE 

111=111+1 
BATCH ( III)  =  TOTAL/NSIZE 
IBEGIN  =  IBEGIN  +  NSIZE 
IFIN  =  IFIN  +  NSIZE 


on  non  oooo 
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10  CONTINUE 

FINALT  =0.0 
DO  20  I  =  1 , NEXTRA 

FINALT  =  FINALT  +  BATCH( I ) 

20  CONTINUE 

COMPARE  =  FINALT/NEXTRA 
ARRAYC(IEXP)  =  COMPARE 

WR I T  E ( 6 , * ) ' US  I NG  A  TOTAL  OF', NEXTRA, 1  BATCHED  POINTS' 
WR I TE( 6, *) ' A  FINAL  COMPARE  VALUE  =', COMPARE 
WRITE(6,*) ' FINAL  NUMBER  OF  DATA  POINTS=’,JJJ 
WR I TE( 6, 1234 ) 

I F( I  EXP  .EQ.  50  .ANO.  KOUNT  .EQ.  16 )THEN 
DO  25  1  =  1, I  EXP 

WRITE( 6,*) I , ARRAYC( I ) 

25  CONTINUE 

WR I TE( 6, * ) '  BIGGEST  SAMPLE  SIZE  =',NSAMPLE 
END  IF 
MSTOP  =  -1 
RETURN 

END  I  F 

30  I F ( KKK  .EQ.  LENROWJMSTOP  =  -1 
RETURN 
END 
C 

C  **  SUBROUTINE  TO  DETERMINE  REQUIRED  BATCH  SIZE  TO  INDUCE 
C  **  NORMALITY  IN  DATA 


SUBROUTINE  SWSUB( DATA, NREP, NS IZE, I  FAULT ) 


SHAPIRO-WILK  TEST  FOR  NORMALITY 
COMMON  /ABC/  J,K,SSQ, I NDCOL( 50 ) , X( 200 ) , W 

DATA  I NDCOL/O, 0,0, 1,3,5,8,11 , 1 5, 1 9, 24, 29, 35, HI , 48, 55, 63 , 71 , 80, 89, 9 
19,109,120,131,143,155,168,181,195,209,224,239,255,271,288,305,323. 
2341,360,379,399,419,440,461,483,505,528,551.575,599/ 

DIMENSION  DATA( 16, 100) 

INITIALIZE  VARI ALBLES 

I  FAULT  =  0 
I  PR  =  0 
NSIZE  =  1 
N  =  NREP 


1111  DO  10  I  =  1 ,  NREP 
SUM  =  0.0 
DO  20  J  =  1, NSIZE 

SUM  =  SUM  +  DATA( I,J) 
20  CONTINUE 

AVG  =  SUM/NS IZE 


oooo  ooo  ooo  ooo  oooooo 


10  CONTINUE 


SORT  DATA  POINTS  IN  ASCENDING  ORDER 

CALL  QSORT  (X,N) 

CALCULATIONS 

IF  ( N. LE. 50)  J= I NDC0L( N) 

K=N/2 
SUM=0 . 

SSQ=0. 

DO  60  1=1, N 

SUM=SUM+X(  I ) 

60  SSQ=SSQ+X( I )*X( I ) 

SSQ=  SSQ- SUM* SUM/ N 

PRINT  ORDERED  DATA  IF  NEEDED 

IF  ( IPR.NE.O)  GO  TO  70 

GET  W  STATISTIC 

70  CALL  TEST(NREP) 


PRINT  CRITICAL  VALUES  IF  NEEDED 

CALL  CRITVAL(N.CRIT) 

I F(W  .LT.  CR I T) THEN 

IF  (NSIZE  . EG.  10JTHEN 

WR I TE( 6, * ) ' BATCH  SIZE  OF  10  FAILS  SHAPIRO-WILK  TEST 
WR I TE( 6, * ) ' TO  DETERMINE  ADEQUATE  VARIANCE  MEASURE’ 
WR I T E ( 6 , * ) ' A  LARGER  INITIAL  SAMPLE  IS  NEEDED' 

I  FAULT  =  10 
RETURN 
END  IF 

NSIZE  =  NSIZE  +  1 
GO  TO  1111 
END  IF 

WR I TE( 6, * ) ' PASSED  THE  SW  TEST  WITH  NSIZE  =', NSIZE 
WR I TE( 6,*)’ CALCULATED  W  =',W,'  CRITICAL  VALUE  =',CRIT 

190  FORMAT  (//) 

C 

C 

RETURN 

END 

SUBROUTINE  TEST(NREP) 


THIS  SUBROUTINE  CALCULATES  THE  SHAPIRO-WILK  W  STATISTIC 


155 


c 

COMMON  /ABC/  J , K, SSQ, I NDCOL( 50 ) , X( 200 ) , W 
COMMON  /COEF/  A(625) 

C 

B=0 

N  =  NREP 
00  10  1=1, K 

10  B=B+A( J+l )*( X( N- I +1 )-X( I )) 

W=B*B/SSQ 

RETURN 

C 

C 

END 

SUBROUTINE  CRITVAL  (N.CRIT) 

C 

C  PRINT  THE  CRITICAL  VALUES  FOR  THE  W  TEST 
C 

COMMON  /CRIT/  T(50,1 ) 

C 

CRIT  =  T(N, 1  ) 

RETURN 

C 

C 

END 

BLOCK  DATA  W 

COMMON  /COEF/  A( 200 ) , C( 200 ) , D( 200 ) , F( 25  ) 

COMMON  /CRIT/  T(50,1) 

DATA  A/. 7071, .6872, .1677, . 6646, . 241 3, . 6431 ,. 2806, . 0875, . 6233 ,. 3031 

1 . .  1401 . .6052. . 3164. . 1743. .0561 . . 5888. . 3244. . 1976. . 0947. . 5739. . 3291 

2. . 2141. . 1224. .0399,-5601, .3315, .2260, . 1429 , . 0695, . 5475, .3325, .2347 

3. .  1586. .0922. .0303. .5359. .3325. .2412. .1707. . 1099 .. 0539. . 5251 .. 33 18 

4. . 2460. .1802. . 1240,-0727, .0240,-5150, . 3306, .2495, .1878, . 1353, .0880 

5. . 0433. .5056. .3290. .2521. . 1939. . 1447. . 1005. .0593. .0196. .4968. . 3273 

6. . 2540. . 1988. .1524. . 1109. .0725. . 0359. . 4886. . 3253. . 2553 . .2027. . 1567 

7. .  1197. .0837. .0496. .0163. .4808. . 3232. .2561,-2059, . 1641 ,. 1271 , .0932 

8. . 0612. .0303. .4734.. 3211. .2565. .2085. . 1686. . 1 334 . . 101 3 . . 0711 . .0422 

9. . 0140. .4643. .3185. .2578. .2119. .1736. . 1399. . 1092. .0804. .0530. .0263 
*, .4590, .3156, .2571, .2131, . 1764, . 1443, .1150, . 0878, . 06 16, . 0368 ,. 0122 
*, .4542, .3126, .2563, .2139, . 1787, . 1 480, . 1201 , . 0941 , . 0696, .0459, .0228 
*, .4493, .3098, .2554, .2145, . 1807, . 1512, . 1245, . 0997, . 0764, .0539, .0321 
*, .0107, .4450, .3069, .2543, .2148, . 1822, .1539, . 1283, . 1046, .0823, .0610 
*, .0403, .0200, .4407, .3043, .2533, .2151, . 1836, . 1563, . 1316, . 1089, .0876 
*, .0672, .0476, .0284, . 0094, . 4366, . 301 8, . 2522, . 21 52, . 1848, . 1584, . 1346 
*, .1128, .0923, .0728, .0540, .0358, .0178, .4328, .2992, .2510, .2151, .1857 
*, .1601, .1372, .1162, .0965, .0778, .0598, .0424, .0253, .0084, .4291, .2968 
*, .2499, .2150/ 

DATA  C/. 1864, .1616, .1395, .1192, .1002, .0822, .065,-0483, .032,. 0159, . 

14254. . 2944. .2487. . 2148. . 1870. . 1 630 . . 1 41 5. . 1 21 9. . 1036,-0862, .0697, . 

20537. . 0381. .0227. .0076. .4220. .2921 . .2475,-2145, . 1874, . 1641 , . 1433, . 

31243. .  1066. .0899. .0739. . 0585. . 0435. . 0289. . 0144. . 4 188. .2898. .2463. . 

42141..  1878.. 1651.. 1449.. 1265. .1093. . 093 1 .. 0777. . 0629. .0485. .0344.. 

50206. . 0068. .4156. .2876. .2451. .2137. . 1880. . 1660. . 1463. . 1284. . 1118. . 
60961,-0812, .0669, .0530, .0395, . 0262, . 01 3 1 , . 4127 , .2854, .2439, .2132, . 

71882. .  1667. . 1475. . 1 301 . . 1 140. . 0988. . 0844. . 0706. . 0572. .0441. .0314. . 

80187. . 0062. .4096. .2834. .2427. .2127. .1883. . 1673. .1487. .1317. .1160. . 
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91013. . 0873. .0739. .0610. . 0484. . 0361 .. 0239. .0119,-4068, . 281 3, . 2415, . 
*2121, . 1883, . 1678, .1496, . 1 33 1 , . 11 79, . 1 036 , .0900, .0770, .0645, .0523, . 
*0404, .0287, .0172, .0057, .4040, . 2794, . 2403 ,. 21 16, . 1883, . 1683, .1505, . 
*1344, .1196, . 1056, .0924, .0798, . 0677, . 0559, . 0444, . 0331 , .0220, .0110,  . 
*4015, .2774, .2391, .2110, . 1881, . 1686, .1513, .1356, . 121 1 ,. 1 075, . 0947, . 
*0824,. 0706, .0592, .0481, .0372, .0264, .0158, .0053, .3989, .2755, .2380, . 
*2104, . 1880, . 1689, .1520, .1366, .1225, .1092, .0967, .0848, .0733, .0622, . 
*0515, .0409, .0305, .0203, .0101, . 3964, . 2737 ,. 2368, . 2098, . 1 878, . 1 691 , . 
*1526, .1376, . 1237, .1108, . 0986, . 0870, . 0759, .0651, .0546, .0444, .0343, . 
*0244, .0146, .0049/ 

DATA  D/.394, .2719, . 2357, . 2091 , . 1876, .1693, . 1531 ,. 1 384, . 1249, . 1 123 , 

1.1004. . 0891. .0782. .0677. .0575. .0476. .0379. .0283. .0188. .0094. .3917, 

2.2701. . 2345. .2085. . 1874. . 1694. . 1535. . 1 392. . 1259. . 1 1 36. . 1020. . 0909, 
3.0804, .0701, .0602, .0506, .0411, .0318, .0227, .0136, .0045, .3894, .2684, 

4.2334. . 2078. .1871. . 1695. .1539. .1398. .1269. . 1149. . 1035,-0927, .0824, 
5.0724, .0628, .0534, .0442, .0352, .0263. .0175, .0087, .3872, .2667, .2323, 

6.2072. . 1868. . 1695. .1542. . 1405. . 1278. . 1 160. . 1049. .0943,-0842, .0745, 
7.0651 , .0560, .0471, .0383, .0296, .021 1 , .0126, .0042, .3850, .2651 , .2313, 

8.2065. .  1865. .1695. .1545. . 1410. . 1286. . 1 1 70. . 1 062. . 0959. . 0860. .0765, 
9.0673, .0584, .0497, .0412, .0328, .0245, .0163, .0081, .3830, .2635, .2302, 
*.2058, . 1862, . 1695, .1548, .1415, .1293, .1180, . 1073, .0972, .0876, .0783, 
*.0694, .0607, .0522, .0439, .0357, .0277, .0197, .0118, .0039, .3808, .2620, 
*.2291,-2052, .1859, .1695, . 1550, . 140, .1300, .1189,-1085, .0986, .0892, 
*.0801, .0713, .0628, .0546, .0465, .0385, .0307, .0229, .0153, .0076, . 3789, 
*.2604, .2281, .2045, . 1855, . 1 693, . 1 551 , . 1423, . 1306, . 1 197, . 1095, .0998, 
*.0906, .0817, .0731, .0648, .0568,. 0489, .0411, .0335, . 0259, . 0185, . 01 1 1 , 
*.0037, .3770, .2589, .2271, .2038, . 1851 , . 1692, . 1553, . 1427, . 1312, . 1205, 
*.1105, . 1010, .0919, .0832, .0748, .0667, .0588, . 051 1 ,. 0436, . 0361 , .0288, 
*.0215, .0143, .0071/ 

DATA  F/. 3751, .2574, .226, .2032, . 1847, . 1691, . 1554, . 143, . 1 31 7, . 1212, . 
11113,  .1020, .0932, .0846, .0764, .0685, .0608, .0532, .0459, .0386,-0314, . 

20244. . 0174. .0104..0035, 

DATA  T/0. ,0. , .789, .792, . 806, . 826, . 838, . 851 , . 659. . 869, . 8 
*76, .883, .889, .895, .901, .906, . 910, . 914 , . 91 7, . 920, . 923, . 926, . 928, . 93 
*0, .931, .933, .935, . 936, . 937, . 939, . 940, . 941 , . 942, . 943 , . 944, .945, .946 
*,.947, .948, .949, .950, . 951 , . 951 , . 952, . 953, .953,-954, .954,-955, .955/ 
C 

END 

SUBROUTINE  QSORT  (X,N) 

C 

C  QUICKSORT  ALGORITHM. 

C 

DIMENSION  X( 1 ),  STACK( 13,2) 

INTEGER  STACK, FIRST 
REAL  MEDIAN, MED 
DATA  MAXSTK/13/.M/10/ 

I TOP=0 
F I RST=1 
NN=N 

10  CONTINUE 

IF  (NN.GT.M)  GO  TO  20 
CALL  SHLSRT  ( X( F I RST ) , NN ) 

IF  ( ITOP.LE.O)  GO  TO  130 
F I RST=STACK( (TOP, 1 J 
NN=STACK( I  TOP, 2) 


on 
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I  TOP= I  TOP-1 
CO  TO  10 
20  CONTINUE 

LAST=F IRST+NN-1 

N1=0 

N2=0 

MEO I AN=MED( X( F I RST ) , NN ) 

I 1=F I RST 
I2=LAST+1 
30  CONTINUE 
1=12-1 

40  CONTINUE 

IF  ( I . LE . I  1  )  CO  TO  80 
IF  (X{ I ). LT. MEDIAN)  GO  TO  50 
1  =  1-1 
N2=N2+1 
GO  TO  40 
50  12=1 

X(  1 1  )=X(  12) 

N1=N1+1 

1=11+1 

60  CONTINUE 

IF  ( I .CE. 12)  CO  TO  90 
IF  (X( I ).GT. MEDIAN)  GO  TO  70 
1  =  1+1 
N1=N1+1 
GO  TO  60 
70  11=1 

X( I2)=X( II) 

N2=N2+1 
GO  TO  30 
80  X( 1 1 )=MEDI AN 
GO  TO  100 
90  X( 1 2 )=MEDI AN 

100  CONTINUE 

I TOP= I TOP+1 

IF  ( ITOP.GT.MAXSTK)  GO  TO  120 
IF  (N1.GT.N2)  GO  TO  110 
STACK( I  TOP, 1 )  =  LAST-N2+1 
STACK(  I  TOP,  2  )=N2 
NN=N1 
GO  TO  10 

110  STACK! I  TOP, 1 )  =  F I RST 
STACK!  I  TOP,  2  )=N1 
F I RST=LAST-N2+1 
NN=N2 
GO  TO  10 

120  CALL  REMARK  (24LSTACK  OVERFLOW  IN  QSORT  ) 
STOP 

130  RETURN 
END 

SUBROUTINE  SHLSRT  (X,N) 

SHELL  SORT. 
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DIMENSION  X(1) 

M=N 

10  CONTINUE 
M=M/2 

IF  (M.EQ.O)  GO  TO  50 

K=N-M 

J=1 

20  CONTINUE 
l=J 

30  CONTINUE 
L=M+I 

IF  (X( I ) . LE.X( L) )  GO  TO  40 
XK=X(  I  ) 

X(  I  )=X(L) 

X(L)=XK 

l=l-M 

IF  ( I.GE.1)  GO  TO  30 
40  CONTINUE 
J=J  +  1 

IF  (J-K)  20,20,10 
50  CONTINUE 
RETURN 
C 

END 

FUNCTION  MED  (X,N) 

C 

C  FUNCTION  TO  GET  A  MEDIAN  ESTIMATE  OF  AN  ARRAY. 
C 

REAL  MED 
DIMENSION  X(1) 

M I D=N/2 
XF=X(  1  ) 

XM=X( MID) 

XL=X( N ) 

IF  (XF.GT.XM)  GO  TO  10 
IF  (XM.LT.XL)  GO  TO  30 
IF  (XF.LT.XL)  GO  TO  40 
GO  TO  20 

10  IF  (XM.GT.XL)  GO  TO  30 
IF  (XF.GT.XL)  GO  TO  40 
20  K=1 

GO  TO  50 
30  K=MID 
GO  TO  50 
40  K=N 
50  MED=X( K) 

X(K)=X(1) 

RETURN 

C 

END 


oooo  ooo  oooo  ooooo  ooooooo 
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ENO  OF  SUBROUTINE  WILK 


••••THIS  IS  THE  SUBROUTINE  THAT  CALCULATES  TRUNCATION  POINT 
••••NEEDED  TO  ELIMINATE  ANY  DETECTED  INITIAL  BIAS 

SUBROUTINE  IBSUB  ( DNORMAL, NS IZE, LENROW, ALPHA, I TRUNC, I  FAULT 
$, BATCH, NUMBAT) 

DIMENSION  BATCH ( 10000 ), DNORMALJ 5000 ) 

#*###* PER FORM  SCHRUBEN  INITIALIZATION  BIAS  TEST 


'** INITIALIZE  VARIABLES 

LENTH  =  LENROW 
OBS  =  LENTH 
JUNK  =  0 
IBEGIN  =  1 
M POINT  =  0 
I  END  =  NSIZE 
I TRUNC  =  0 
KOUNT  =  0 


75  NUMBAT  *  OBS/NSIZE 
NSTART  =  IBEGIN 
POINTS  =  FLOAT( NUMBAT) 

KOUNT  =  KOUNT  +  1 
NFIN  *  I  END 
DO  150  K=1, NUMBAT 
BATSUM  =0.0 
DO  100  l=NSTART, NF I N 
BATSUM  =  BATSUM  ♦  DNORMAH I ) 
100  CONTINUE 

•••••COMPUTE  MEAN  OF  EACH  BATCH 

BATCH(K)  =  BATSUM/NSIZE 
NSTART  =  NSTART  +  NSIZE 
NFIN  =  NFIN  ♦  NSIZE 
150  CONTINUE 


••COMPUTE  SUM  OF  SAFE  BATCH  MEANS 

TOT  =  0.0 
NHALF  =  NUMBAT/2 


oooo  oooooo  ooo  oooooo  o  ooooo 
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MID  =  NHALF  +  1 
00  200  f=MID,NUMBAT 
TOT  =  TOT  +  BATCH( I ) 
200  CONTINUE 


****CALL  TO  SUBROUTINE  TO  CALCULATE  VARIANCE  BY  WELCH  PROCEDURE 
CALL  WELCH! BATCH, M I D, NUMBAT, ZERO ) 

GAMMA  =  ZERO 


*****  initialize  variables  used  during 
*****EACH  pass  through  the  data 


AMAX  =0.0 
CUSUM  =0.0 
PMEAN  =0.0 
AMIN  =  0.0 
PSUM  =  0.0 
M  =  0 
NEGTIV  =  0 
POST  IV  =  0 
TOTAL  =0.0 

*****COMPUTE  MEAN  OF  ALL  DATA 

DO  325  I  =  1, NUMBAT 

TOTAL  =  TOTAL  +  BATCH! I ) 
325  CONTINUE 

AMEAN  =  TOTAL/NUMBAT 


*****TEST  FOR  INITIALIZATION  BIAS 
*****FIND  MOST  POSITIVE  AND  NEGATIVE 
*****VALUES  OF  NORMALIZED  CUSUM 

SQROOT  =  SQRT( POINTS) 

DO  500  1=1, NUMBAT 
M  =  M+1 

PSUM  =  PSUM+BATCH! I ) 

PMEAN  =  PSUM/M 
CUSUM  =  AMEAN- PMEAN 

*****BLOCK  TO  CHECK  FOR  NEGATIVE  VALUES  OF  CUSUM 
*****AN0  SAVE  MOST  NEGATIVE  VALUE 

I F( CUSUM  .LT.  O.OJTHEN 
NEGTIV  =  1 

SNEG  =  (M*CUSUM) /SQROOT 
I F( SNEG. LT . AM  I N )THEN 
AM  I N= SNEG 


nnnonnnnn  oooo 
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NEGLOC  =  M 
END  IF 
GO  TO  500 
END  IF 


STAR  =  (M*CUSUM)/SQR00T 
I F( STAR  .GT.  AMAX) THEN 
POST  IV  =  1 
AMAX  =  STAR 
MPOINT  =  M 
END  IF 
500  CONTINUE 

*****BLOCK  TO  CHECK  IF  ONLY  POSITIVE 

*****  initial  bias  indicated 

I F( ( NEGT I V  .GT.  0)  .AND. 

+  ( POST  IV  .LT.  1.0) (THEN 
AMAX  =  AMIN 
MPOINT  = NEGLOC 
GO  TO  501 
END  IF 

*****BLOCK  TO  CHECK  IF  OSCILLATION  OF 
*****NEGATIVE  AND  POSITIVE  BIAS  INDICATED. 

♦•"♦"STANDARDIZE  TO  UNIT  INTERVAL. 

*****CHECK  USING  SAME  SCHRUBEN  TEST 
*****EXCEPT  USING  ALPHA/2. 

I F( ( NEGT IV  .GT.  0 ) . AND. ( POST  I V. GT. 0) )THEN 
TN  =  FLOAT( NEGLOC ) / PO I  NTS 
TP  =  FLOAT ( MPO I  NT )/P0 1  NTS 
XP=(AMAX**2)/(3*GAMMA*TP*(  1-TP) ) 
XN=(AMIN**2)/(3*GAMMA*TN*( 1-TN) ) 

DFN  =3. 

DFD=PO I  NTS/2 
X  ~  XP 

CALL  MDFDRE(X, DFN, DFD, P, IER) 

PROPOS  =  1.  -  P 
X  =XN 

CALL  MDFDRE( X, DFN, DFD, P, IER) 

PRONEG  =  1.0  -  P 
HALPHA  =  ALPHA/2. 

I F(( PROPOS  .AND. PRONEG) 

+  .LT.  HALPHA)THEN 

MPO I NT=MAXO ( MPO I  NT, NEGLOC ) 

GO  TO  913 
END  IF 

I F(( PROPOS  .AND.  PRONEG) 

♦  .GE.  HALPHAJTHEN 

GO  TO  974 
END  IF 


ooooooooo  oooo  oo 
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NEGLOC  =  M 
ENO  IF 
GO  TO  500 
END  IF 


STAR  =  (M*CUSUM)/SQR00T 
I F ( STAR  .CT.  AMAX) THEN 
POST  IV  =  1 
AMAX  =  STAR 
MPOINT  =  M 
END  IF 
500  CONTINUE 

*****BL0CK  TO  CHECK  IF  ONLY  POSITIVE 
*****  INITIAL  BIAS  INDICATED 

I F( ( NEGT I V  .GT.  0)  .AND. 

♦(POSTIV  .LT.  1.0)  )THEN 
AMAX  =  AMIN 
MPOINT  = NEGLOC 
GO  TO  501 
END  IF 

*****BLOCK  TO  CHECK  IF  OSCILLATION  OF 
*****NEGATIVE  AND  POSITIVE  BIAS  INDICATED. 

♦♦•♦♦STANDARDIZE  TO  UNIT  INTERVAL. 

*##**CHECK  USING  SAME  SCHRUBEN  TEST 
*****EXCEPT  USING  ALPHA/2. 

I F ( ( NEGT I V  .GT.  0 ). AND. ( POST  IV. GT. 0 ) (THEN 
TN  =  FLOAT ( NEGLOC )/PO I  NTS 
TP  =  FLOAT (MPOINT)/ POINTS 
XP=(AMAX**2)/(3*GAMMA*TP*( 1-TP) ) 

XN=( AM  I N**2 )/( 3*GAMMA*TN*( 1 -TN)  ) 

DFN  =3. 

DFD= POINTS/2 
X  =  XP 

CALL  MDFDRE(X,  OFN,  OFD,  P, I ER ) 

PROPOS  =  1 .  -  P 
X  =XN 

CALL  MDFDRE( X, DFN,DFD,P, IER) 

PRONEG  =  1.0  -  P 
HALPHA  =  ALPHA/2. 

I F(( PROPOS  .AND. PRONEG) 

+  .LT.  HALPHA) THEN 

MPO I NT=MAX0( MPO I  NT, NEGLOC ) 

GO  TO  913 
END  IF 

I F(( PROPOS  .AND.  PRONEG) 

+  .GE.  HALPHA) THEN 

GO  TO  974 
END  IF 


nnoo  o  ooooo  nnno  cinoannn  oo  non 
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I F ( PROPOS  .LT.  HALPHAJTHEN 
GO  TO  913 

ELSE 

MPOINT  =  NEGLOC 
GO  TO  913 
END  IF 
END  IF 

**###BLOCK  TO  CALCULATE  VIA  SCHRUBEN 
*****BROWN I  AN  BRIDGE  TEST  INDICATION 
****#OF  INITIAL  BIAS  OF  ONLY  ONE  SIGN 

501  T  =  FLOAT (MPOINT)/ POINTS 

X  =  ( AMAX**2 )/( 3 . *GAMMA*T*( 1 . -T ) ) 

DFN  =  3. 

DFD  =  POINTS/2 

CALL  MDFDRE( X, DFN , DFD, P, IER) 

I F( I ER  .EQ.  129JTHEN 

WR I TE( 6, * ) 1 IER  ERROR' 

STOP 
END  IF 

PROBAB  =  1 . 0  -  P 
I F( PROBAB  .LT.  ALPHA) THEN 

*****BLOCK  TO  OVERRIDE, IF  NECESSARY, 
*****TRUCATION  POINT  TO  ALLOW  AT  LEAST  TWO 
*****PASSES  TO  ELIMINATE  INITIAL  BIAS 
*****POINT  =  . 25*DATA 


913  CONTINUE 

MAXPNT  =  I F I X ( . 25*NUMBAT ) 

I F( MPO I  NT  .GT.  MAXPNT ) THEN 
MPOINT  =  MAXPNT 
END  IF 


*****ITRUNC  EQUALS  THE  TRUNCATION  POINT 

ITRUNC  =  ITRUNC  +  MPOINT 

w*#**bLOCK  TO  SEE  IF  THE  TEST  PROCEDURE  HAS 
*****TRUNCATED  AN  EXCESSIVE  AMOUNT  OF  DATA 
*****(50%)  AND  STILL  NOT  ELIMINATED  INITIAL  BIAS 

JUNK  =  ITRUNC*NSIZE 

I F( JUNK  .GT.  ( 0 . 5*LENTH ) JTHEN 
I  FAULT  =  50 
RETURN 
END  IF 

*****CALCULATE  NUMBER  OF  DATA  POINTS 
*****LEFT  AND  RETEST  USING  ONLY  THESE  POINTS 


! 

1 

, 

•i 

?  .5 

ft  : 

t  J 
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OBS  =  OBS  -  (MPOINT*NSIZE) 

IBEGIN  =  IBEGIN  +  ( MPOI NT*NSIZE ) 
I  END  =  IBEGIN  +  (NSIZE  -  1) 

GO  TO  75 

ELSE 


*****SHOW  FINAL  TRUNCATION  POINT 
*****AND  COMPUTED  MEAN 

974  CONTINUE 
END  IF 
I  FAULT  =  0 
RETURN 
END 


END  OF  IB  DETECTION  SUBROUTINE  ************************ 


**  SUBROUTINE  TO  CALCULATE  REQUIRED  RUN  LENGTH  OF  SIMULATION 

**  TO  COMPARE  ALTERNAT I VES--A  MULTIPLE  RANKING  PROCEDURE - 

**  CALCULATIONS  BASED  ON  EXTENT  I  ON  OF  DUDEWICZ-DALAL  MRP 
**  TO  ADDRESS  ANY  STATIONARY  ARMA(P.Q)  PROCESS.  EXTENT  I  ON 
**  OF  EXISTING  PROCEDURE  OONE  BY  J.  R.  WILSON  AND  R.  T.  DICKINSON 
**  UNIVERSITY  OF  TEXAS  1983 


SUBROUTINE  MRPSUB( NUMBAT, BATCH, NEXTRA, I  FAULT) 
DIMENSION  BATCH( 10000) 


C  **  THIS  IS  WHERE  THE  VALUES  OF  THE  PARAMETERS  USED  BY  THE 
C  **  MULTIPLE  RANKING  PROCEDURE  ARE  SET 

C  **  KPOP— EQUALS  THE  NUMBER  OF  ALTERNATIVES  UNDER  CONSIDERATION 
C  **  DSTAR— IS  THE  WIDTH  OF  THE  INDIFFERENCE  ZONE 
C  **  PCS— IS  THE  DESIRED  PROBABILITY  OF  CORRECT  SELECTION 


C  **  NMAX  IS  USED  TO  RECORD  THE  LARGEST  SAMPLE  SIZE  REQUIRED 
C  **  DURING  THIS  EXPERIMENT 

c mnnHnnnHnntn»n  initialize  variables  tmnnnnunnumn«innnniinnnniH 

NMAX  =  0 
DSTAR  =0.1 
PCS  =  .900 
KPOP  =  3 


L 
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zmmmmmmmmmmiimtmmmmmm 

C HHtfMt  CALL  SUBROUTINE  TO  CALCULATE  MM/tHt »****##### 
CMHtMt  DUDEWICZ  AND  DALAL  H  VALUE  (DNDH)  ########### 
C 
C 

CALL  RNKSEL) NUMBAT, KPOP, PCS, DNDH ) 

C 

c 

zmmmmmMmmmmmmmmmmmm 

MID  =  1 

CALL  WELCH ( BATCH , M I D , NUMBAT .ZERO) 

VAR  =  ZERO 


CMtHMt 

cwm 

c 


DETERMINE  IF  LARGER  SAMPLE  SIZE  (NEXTRA)  ### 
IS  NEEDED  BASED  ON  DUDEWICZ,  RAMBERG,  AND  ### 
CHEN  PROCEDURE.  NEXTRA  .GT.  NUMBAT  ### 


I DDOBS= ( ( VAR*<  DNDH**2 ) ) / ( DSTAR**2 ) )  + . 999999 
NEXTRA  =  MAXO ( NUMBAT, I DDOBS) 
tF (NEXTRA  .GT.  NUMBAT) THEN 
I  FAULT  =  100 
RETURN 
ENO  IF 


NMAX  =  NEXTRA 

WR I T  E ( 6 , 1 1 0 ) PCS , OSTAR , NUMBAT , DNDH , NMAX 
110  FORMAT) ///, 6X, 1  FOR  THIS  TEST:  PCS  =',F4.3, 
$*  DSTAR  =',F5.2,/,6X, '  NUMBAT  =’,  14, ’ 
$'  NMAX  =’, 15) 


’,F5.3, 


RETURN 

END 


C  **  SUBROUTINE  TO  CALCULATE  THE  CRITICAL  DUDEWICZ 
C  **  DALAL  H  VALUE  NECESSARY  TO  DETERMINE  REQUIRED 
C  **  SIMULATION  RUN  LENGTH 

C 

SUBROUTINE  RNKSEL) NO, K, PSTAR, H ) 

COMMON/RSTOL/TOLF, HTOLF, NSI CD, AERR, RERR, ITMAX 

COMMON/RSCON/PI , TOLZ, B I  CM 

TOLF  =  1.E-6 

AERR  =  1.E-8 

NSIGD  =  5 

RERR  =  1.E-8 

ITMAX  =  500 
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PI  =  3.1415926535 
TOLZ  =  1.E-20 
BICM=  1.E20 

H  =  HO( NO, K, PSTAR, I  FAULT ) 

RETURN 

END 

FUNCTION  HO( NNO, KK, PPSTAR, I  FAULT) 

EXTERNAL  CFUNC 

COMMON/ RSTOL/ TOL F, HTOLF, NS  I GD, AERR, RERR, ITMAX 
COMMON/ RSCON/P I , TOLZ, B I GM 

COMMON/RSTOST/NO, OF , K, KM1 , CNORM, XPNT, A, B, PSTAR, HTEMP 
DIMENSION  WK( 30), PAR(1),H(1) 

DATA  NDIM/1/ 

NO  =  NNO 
K  =  KK 

PSTAR  =  PPSTAR 

HO  =  -BIGM 

I  FAULT  =  0 

OF  =  NO  -  1 

KM1  =  K  -  1 

XPNT  =  (DF  +  1.0J/2.0 

CNORM  =  GAMMA( XPNT )/(  GAMMA( 0 . 5*DF )*SQRT( P I *DF )  ) 

HTOLF  =  T0LF/2.0 

CALL  MOST  I ( HTOLF, DF, B, I ER) 

IF  ( I ER  .NE.  0)  THEN 
I  FAULT  =  IER  +  1000 
RETURN 
END  IF 
A  =  -B 
H(  1  )  =  0.0 

CALL  ZSCNT( GFUNC, NS  I GD, ND IM, I TMAX, PAR, H, FNORM, WK, IER) 
HO  =  H(1) 

IF  (IER  .NE.  0)  THEN 

I  FAULT  =  2000  +  IER 

END  IF 

RETURN 

END 

SUBROUTINE  GFUNC( H, G, ND I M, PAR ) 

DIMENSION  H(NDIM),G(NDIM), PAR( 1 } 

COMMON/RSTOL/TOLF, HTOLF, NS IGD, AERR, RERR, I TMAX 
COMMON/RSCON/P I , TOLZ, B I GM 

COMMON/RSTDST/NO, DF, K, KM1 , CNORM, XPNT, A, B, PSTAR, HTEMP 
EXTERNAL  SUMMNO 
HTEMP  =  H( 1 ) 

GTEMP  =  DCADRE( SUMMND, A, B, AERR, RERR, ERROR, IER) 

IF  ( IER. GE. 100)  THEN 
I  FAULT  =  3000  +  IER 
WRITE  (6.100)  I  FAULT 

100  FORMAT  (’  ***ERR0R  IN  DCADRE  =  ',14,'  ***' ) 

STOP 
END  IF 

C(1)  =  GTEMP  -  PSTAR 

RETURN 

END 

FUNCTION  SUMMND(T) 


uuuuuuuuu  uu 
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COMMON/RSTOL/TOLF, HTOLF , NS  I  CD, AERR, RERR, I TMAX 
COMMON/RSCON/P I , TOLZ, B I GM  „Tru„ 

COMMON/RSTDST/NO, DF , K, KM1 , CNORM, XPNT, A, B, PSTAR, HTEMP 
FI  =  CNORM* (  (1.0  +  T*T/DF )**{ -XPNT )  ) 

X  =  T  +  HTEMP 

CALL  MDTD(  ABS(X),  DF.  TAILS,  IER) 

IF  (IER  .GT.  0)  THEN 
I  FAULT  =  4000  +  IER 
WRITE  (6,100)  I  FAULT 

FORMAT  ('  ***ERROR  IN  MDTD  =  ’,14,'  ***' ) 

END  !F 

F2  =  0.5  +  SIGN(0.5,X)*( 1 .0  -  TAILS) 


SUMMND  =  F1*(  F2**KM1  ) 

RETURN 

END 


C  ****************************  END  MRPSUB 


****SUBROUT I NE  WELCH  USED  TO  DETERMINE  VARIANCE  BY  USE  OF  SPECTRAL 
****DENSITY  AT  ZERO  FREQUENCY  PER  ARTICLE  BY  HE  I DELBURGER 
**  ANO  WELCH.  THIS  SUBROUTINE  CALLED  BY  BOTH  IBSUB 
**  AND  MRPSUB. 


SUBROUTINE  WELCH  ( BATCH, M I D, NUMBAT, ZERO ) 

DIMENSION  P£RIOD(600),XM(6),TEMP(6), 8(6,7)  .. 

$,AN0VA(16),VARB(21 ),FJ( 300), I WK( 3200), WK( 3200), V( 300,6 ),VCV( 21 ) 

$, NBR( 6 ) , ALFA( 2 ) , I J0B( 2 ) , I ND( 1 1 ) , XYB( 6, 5 ) , A( 300, 6 ) ,CHECK( 2000 ) 
DIMENSION  BATCH( 10000) 

COMPLEX  TRANS(600) 


NUMDAT  =  NUMBAT  -  MID  +  1 
INUM  =  0 

DO  10  I  =  MID, NUMBAT 
INUM  =  INUM  +  1 
CHECK) INUM)  =  BATCH ( I ) 

10  CONTINUE 

NHDATA  =  NUMDAT/2 
NQDATA  =  NHDATA/2 

CALL  FFTRC( CHECK, NUMDAT, TRANS, IWK,WK) 
MMM  =  NHDATA  +  1 
DO  15  L=2,MMM 
K  =  L  -  1 

PERIOD) K)=(CABS(TRANS( L) )**2)/NUMDAT 
15  CONTINUE 

DO  30  KL=1, NQDATA 
KK  =2*KL 
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JJ  =  KK-1 

SMOTH=((PERIOO(JJ )+PERIOO( KK) )/2.0) 

FJ ( KL )=ALOG( SMOTH )  +  .270 
30  CONTINUE 

DO  50  1=1 .NQDATA 
A(  1,1)  =  I 
A(  I  ,2)  =  1*1 

A(  1,3)  =  1**3 
A(  1 ,4)  =  1**4 
A(  1,5)  =  1**5 

A(  1,6)  =  FJ(  I  ) 

50  CONTINUE 
M  =  5 
IB  =  6 
I  ND(  1  )  =  0 
I  ND(  2  )  =  0 
I  ND(  3  )  =  0 
I  ND(  4  )  =  0 
I  ND(  5  )  =  0 
I  JOB ( 1 )  =  0 
I JOB( 2 )  =  1 
ALFA( 1 )  =  .05 
ALFA( 2 )  =  .05 
NRDIM  =  300 

CALL  RLSEP( A, NQDATA, M, NRDIM, ALFA, I  JOB, I ND, ANOVA, XYB, I B, VARB, IER) 
J  =  0 

DO  2000  1=1,5 

IF  (XYB( 1,2)  .NE.  OJTHEN 
J  =  J  +  1 

DO  2100  LL  =  1 , NQDATA 
V(LL,J)  =  LL** I 
2100  CONTINUE 

END  IF 
2000  CONTINUE 

I F ( J  .EQ.  OJTHEN 

ZERO  =  EXP( XYB( 6, 2 )  ) 

RETURN 
ELSE 
J  =  J  +  1 

DO  2200  I  =  1, NQDATA 
V<  l,J)  =  FJ(  I  ) 

2200  CONTINUE 
NVAR  =  J 
NBR( 1 )  =  NVAR 
NBR( 2 )  =  NQDATA 
NBR( 3 )  =  NQDATA 
NBR( 4 )  =  1 
NBR( 5 )  =  1 
NBR( 6 )  =  1 

CALL  BECOVM(V, NRDIM, NBR, TEMP, XM.VCV, IER) 

I  VAR  =  NVAR  -  1 
ALPHA  =0.05 

CALL  RLMUL(VCV,XM, NQDATA, I  VAR, ALPHA, ANOVA, B, IB, VARB, IER) 

UPLEFT  =  ( B( NVAR, 4 )**2 )/ ANOVA ( 8 ) 

ADJUST  =  ( ,645*UPLEFT)/2.0 
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CONE  =  EXP( -ADJUST) 

ZERO  =  CONE*{  EXP(  B(  NVAR,  1  ) ) ) 

END  IF 

RETURN 

END 


i 


APPENDIX  F 
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c  ** 
c  ** 
c  ** 
c  ** 
c  ** 
c  ** 


THIS  PROGRAM  IS  SLAM  SIMULATION  USED  TO  MODEL  AN  (S.S) 
INVENTORY  SYSTEM  FOR  100  YEARS.  THE  WEEKLY  INVENTORY 
HOLDING  COSTS,  SHORTAGE  COSTS,  AND  ORDERING  COSTS  ARE 
SET  BY  THE  USER  (DEFAULT  VALUES  ARE  INCLUDED). 

THE  MODELWILL  INITIALIZE  THE  SYSTEM  IN  YEAR  1  AT  AN 
INVENTORY  LEVEL  OF  BIG  S 


C  ** 
C  ** 
C  ** 
C  ** 
C  ** 


THE  STEADY  STAE  PERFOMANCE  MEASURE  FOR  COMPARING  THE 
ALTERNATIVE  REORDER  POINT  (LITTLES)  AND  THE  ORDER  UP 
TO  LEVEL  (IBIGS)  AGAINST  OTHERS  IS  CALCULATED  BY  THE 
INTEGRATED  MULTIPLE  RANKING  PROCEDURE  DEVELOPED  BY 
J  WILSON  AND  T  DICKINSON  AT  THE  UNIVERSITY  OF  TEXAS 


C  ** 
C  ** 
C  ** 


THE  CODE  WRITTEN  STARTING  AT  SUBROUTINE  NQUE  MAY  BE  LIFTED 
AND  USED  AS  A  MULTIPLE  RANKING  PROCEDURE  FOR  ANY  DISCRETE 
EVENT  SIMULATION  WRITEEN  USING  SLAM 


C  **  IT  IS  POSSIBLE  WITH  MINOR  MOD  I FCAT I  ON  TO  USE  THIS  PROCEDURE 
C  **  ON  A  SIMULATION  UTILIZING  ANOTHER  LANGUAGE 


C 


PROGRAM  MAI N( I NPUT, OUTPUT, TAPE5= I NPUT, TAPE6=OUTPUT, TAPE7. TAPE8 ) 

COMMON/SCOM 1/°ATR I B( 1 00 ) , DD( 1 00 ) , DDL( 1 00 ) , DTNOW, I  I ,  I MFA, MSTOP, NCLNR 

1 . NCRDR, NPRNT, NNRUN, NNSET, NTAPE, SS( 100 ),SSL{ 100 ) , TNEXT, TNOW, XX( 100) 

2,  NSTRM, KOUNT , NS IZE, ALPHA, LI TTLES, I B I GS, KKK, LENROW, NREP , I  EXP 


NNSET  =  5000 
NCRDR  =  5 
NPRNT  =  6 
NTAPE  =  7 
NSTRM  =  7 
KOUNT  =  0 
LITTLES  =  2 
IBIGS  ■  6 
LENROW  =  100 
NREP  =  16 
NSIZE  =  1 
ALPHA  =  .1 
CALL  SLAM 
STOP 
END 


C  **  SLAM  SUBROUTINE  TO  SET  INITAL  CONDITIONS  FOR  THE  SIMULATION 


COMMON/SCOM1 /  ATR I B( 1 00 ) , DD( 100 ) , DDL( 1 00 ) , DTNOW, I  I , MFA, MSTOP, NCLNR 
I^NCRDRfNPRNTfNNRUNfNNSETlNTAPE, SS( 100) , SSL( ?22Dnu^MQrp^?EXP^^  ^ 
2*NSTRM, KOUNT, NSIZE, ALPHA, LITTLES, IBIGS, KKK, LENROW, NREP, IEXP 


onno  noon 
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COMMON/STOCK/ I DMD( 52 ) , BUFFR( 7 ) , I NVHAND, TOTALC, HC, OC, SC 
C 

C***#  SET  UP  INITIAL  CONDITIONS  FOR  MODEL 
C 


C 

DO  5  1=1,52 
I DMD(  I  )  =  0 
5  CONTINUE 


TOTALC  =  0 

C  **  SET  VALUES  FOR  ORDER  I NG, HOLD  I NG  AND  SHORTAGE 
HC  =  0.1 
OC  =  0.5 
SC  =  1.0 


C  **  INITIALIZE  INVENTORY  ON  HAND  TO  IBIGS 
I NVHAND  =  IBIGS 


•***  INITIALIZE  KKK  FOR  EACH  RUN 
KKK  =  0 


I F ( MOD( NNRUN, 16 )  .NE.  0)THEN 
IMUL  =  NNRUN/16 
I  EXP  =  IMUL  +  1 
KOUNT  =  NNRUN  -  ( IMUL*16) 

ELSE 

KOUNT  =  16 
I  EXP  =  NNRUN/16 
END  IF 

IF  (KOUNT  . EQ. 1 JTHEN 

WR I TE( 6, * ) '  EXPERIMENT  NUMBER  =’,IEXP 
END  IF 


C***»  POST  ENTRY  ON  EVENT  CALENDAR  WITH  EVENT  CODE  =  1,  DELAY  =00.0 


on  oo 
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c 

CALL  SCHDL( 1,0.0, ATRlB) 

RETURN 

END 


C  **  SUBROUTINE  TO  SCHEDULE  PERIODIC  INVENTORY  REVIEWS 
C  **  AND  COLLECTION  OF  YEARLY  COSTS  BY  THE  ANALYSIS  ROUTINE 


SUBROUTINE  EVENT( ICODE) 

C 

C**#*  INVOKE  APPROPRIATE  EVENT  PROCESSING  ROUTINE 
C 

GO  TO  ( 10,20), ICODE 

ARRIVAL  EVENT 
10  CALL  INVENT 
RETURN 

DATA  EVENT 
20  CALL  NQUE 
RETURN 
END 
C 


C  **  SLAM  SUBROUTINE  TO  CALCULATE  YEAR  INVENTORY  COST 


C 

SUBROUTINE  INVENT 

COMMON/ SCOM 1 /  ATR I B( 100), DD( 100),DDL( 100),DTNOW, I  I , MFA, MSTOP, NCLNR 

1 ,  NCRDR, NPRNT,NNRUN,NNSET,NTAPE,SS( 100),SSL( 100  ) , TNEXT, TNOW, XX( 100) 

2. NSTRM, KOUNT, NS  I ZE, ALPHA, LITTLES, IBIGS, KKK, LENROW, NREP, I  EXP 
COMMON/STOCK/ I DMD( 52 ) , BUFFR( 7 ) , I NVHAND, TOTALC, HC, OC, SC 

D I  MENS  ION  OCOST( 52 ) , BCOST( 52 ) , CWEEK( 52 ) , CCOST( 52 ) 

CALL  SCHDL( 1,0.1, ATR I B ) 

DO  10  1=1  52 
OCOST( I )  =  0.0 
CCOST ( I )  =  0.0 
BCOST ( I )  =0.0 
CWEEK( I )  =0.0 
I DMD( I )  =  0 
10  CONTINUE 


XX(1)  =  0.0 
TOTALC  =0.0 


* 
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C  **  FIGURE  WEEKLY  COSTS 
DO  20  I  1  =  1,52 


C  **  DETERMINE  DEMAND 

40  IDMD(II)  =  UNFRM( 0. ,7. , NSTRM) 

I F ( I DMD( II)  .EQ.  7 )G0  TO  40 
C  **  UPDATA  INVENTORY  LEFT 

INVHAND  =  INVHAND  -  IDMD(II) 


C  **  IF  CANNOT  MEET  DEMAND  CHARGE  SHORTAGE  COST 

I F ( INVHAND  .LT.  0 ) THEN 

BCOST(II)  =  (- INVHAND )*SC 

ELSE 

C  **  IF  NOT  SHORTAGE  COST  CHARGE  HOLDING  COST 
CCOST(II)  =  I NVHAND*HC 
END  IF 

C  **  DETERMINE  THE  ORDER  NEEDED  BASED  ON  THIS  WEEKS  TRANSACTIONS 

IF( INVHAND  .LT.  LI TTLES ) THEN 
OCOST (  I  I )  =  OC 
INVHAND  =  I  BIGS 
END  IF 


C  **  TOTAL  WEEKLY  COSTS 


CWEEM  M )  =  OCOST ( I  I )+BCOST( I  I )+CCOST( I  I ) 
TOTALC  =  TOTALC  +  CWEEK( II) 

20  CONTINUE 


C  **  THE  SLAM  VARIABLE  XX( 1 )  IS  USED  TO  PASS  THE  YEARLY  COST 
C  **  INFORMATION  TO  THE  ANALYSIS  ROUTINE 
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XX( 1 )  =  TOTALC 

MMM  =  MMM  +  1 

CALL  SCHDL( 2, 0. 0, ATR I B ) 

RETURN 

END 


C 

C 

C 


C  **  SUBROUTINE  TO  COLLECT  DATA  AND  CALL  APPROPRIATE  SUBROUTINE 
C  **  WHEN  INITIAL  SIMULATION  RUNS  ARE  COMPLtTE--CALLS  SUBROUTINES 
C  **  TO  INDUCE  NORMALI TY(WI LK) ,  DETECT  AND  TRUNCATE  INITIAL  BIAS 
C  **  ( I BSUB ) ,  AND  CALCULATE  REQUIRED  SIMULATION  RUN  LENGTH! MR PSUB ) 

C  **  BASED  ON  THIS  RUN  LENGTH  THE  ROUTINE  CALCULATES 
C  **  STATISTIC  (COMPARE)  USED  TO  RANK  ALTERNATIVES 


C 

c 

C 

SUBROUTINE  NQUE 

COMMON/ SCOM 1 /  ATR I B( 1 00 ) , DD( 1 00 ) , DDL( 100),DTNOW, I  I , MFA.MSTOP, NCLNR 

1 ,  NCRDR, NPRNT, NNRUN, NNSET, NTAPE, SS( 1 00 ) , SSL( 100 ) , TNEXT, TNOW, XX( 100) 

2,  NSTRM, KOUNT, NS IZE, ALPHA, LITTLES,  I  B I  GS,  KKK,  LENROW,  NREP,  I  EXP 
DIMENSION  BUFFR( 7 ) , ADD( 1 5000 ) , DATA( 16,100), BATCH ( 5000 ) 

$, DNORMAL( 5000 ) , ARRAYC( 100 ) 


i/i/i/  -  i/i/i/  +  i 

IF  (  I  FAULT  .EQ.  50)  GO  TO  1990 


I F( KKK  .GT.  LENROW )G0  TO  7 

IBDATA  =  LENROW 

DATA( KOUNT, KKK)  =  XX( 1  ) 

I F( KOUNT. EQ. NREP. AND. KKK. EQ. LENROW) THEN 
LLL  =  0 

CALL  SWSUB( DATA, NREP, NS  I ZE, I  FAULT) 


IF  (NSIZE  .GT.  3  .AND.  I  FAULT  .NE.  10 (THEN 

WR I TE( 6, # ) '  PASSED  SW  TEST  BUT  NSIZE  TOO  BIG’ 
NSIZE  =  3 
END  IF 

IF  ( I  FAULT  .Eq.  10 )THEN 

WR  I  TE(  6,  * ) 1  PROBLEMS  NSIZE  TO'  BIG’ 

WR I TE( 6, * ) ’CONT I NUE  WITH  NSIZL  =  3’ 

NSIZE  =  3 
END  IF 


MICROCOPY  RESOLUTION  TEST  CHART 
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